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SPECIAL NOTE 



This monograph is one of a series emit led CETA Program Models prepared for the Employ- 
ment and Training Administration's Office of Community Employment Programs, with fman- 
cial support by the Office of Research and Development. The series, on program activities and 
services, was prepared under contract number Si-1 1-71-^ with the National Council on Em- 
ployment Policy and edited by Garth Mangum of the University of Utah. 

The monographs being issued or prepared for publication are On-the-job Training by James 
Bromley and Larry Wardle; Job Development and Placemem by Miriam Johnson and Marged 
Sugannan; Classroom Training— The OIC Approach by Calvin Pressiey and James McGraw; 
Supportive Services by Susan Turner and Carolyn Gonradus; Intake and Assessmcitt by Lee 
Bruno; Work Experience Perspectives by Marion Pines and James Morlock; and Public Service 
Employment by Ray Corpuz. Others may be added as circumstances warrant. 

The authors, experienced employment and training program operators themselves, review the 
purposes and means of carrying out CETA functions and comment on piethods they have found 
useful in conducting programs and avoiding pitfalls. The series is commended not oniy to 
program operators and their staffs, but also to community groups and other employment and 
trailing services professionals in the hope that this information will enable hiore people to learn 
about CETA programs, stimulate new ideas, and Contribute to improving the quality of em- 
ployment and training programs. 

The series should not be regarded as official policy or requirements of the U.S. Department of 
Labor. Ahhough every effort has been made to assure that the information is consistent with 
present regulations, prime sponsors are urged to consult current regulations before adopting 
changes the authors may advocate. The authors are solely responsible for the content. 

Another series of use to CE^ A prime sponsors; and their staffs is CETA Titlc-VI Project 
Description Reports. There arfe two volumes in this series. The first monograph was prepared by 
MDC, Inc., Chapel Hill, N.C., under contract number 82-37-7M7. The second volume was 
pi-epared by ETA with assistance from prime sponsoi-s, regional offices, and a private 
contractor. 

Copies of other titles in these series may be obtained from: 

Office of Community Employment Programs 
Employment and Training Administration 
U.S. Department of Labor 
601 D Street, NW. \ 

Washington, D.C. 20213 ' " ■ 



Reader comments and suggestions are welcomed and may be sent to t^e above address. 



-PREFACE 



A frank discussion of client assessment in its broadest terms necessarily raises issues and 
generates .differing opinions concerning intake and assessment as program components. In 
many instances, the object of assessment is an applicant for an employment or training service 
who is disadvantaged as ^ consequence of poverty, minority status, or >Qther employment 
handicaps.^ . " . ; 

There is a serious lack of vaHdaled assessment techniques for accurately Evaluating these 
clients. Routine use of some standardised tests in these cases has generated lawsuits by clients 
who contend that, because of their particular circumstances, the tests were discriminatory. 
Many recent court decisions have upheld this contention. It now appears prudent to have any 
client-screening process reviewed by an authority on equal emplovrnj^nt opportunity compliance. 

.Another issue ccnc-erns client involvement in the intake and assessment process. It must be 
emphasii^cd that such^arp^rocess should be regarded primarily as a service to clients. Offering 
models that demonstrate how management may benefit from client assessment should not de- 
tract from the ciient-ccntered approach; nor .should the use of structured assessment tools in a 
syste«T:at!C attempt to solicit useful ciient^data be regarded as dehumanizing. Rather, it 1s pro- 
posed that the methodology and niodel variations discussed herein would serve to more clearly 
define the judgmental parameters within which program staff could operate to the ultimate ben- 
efit of the client. 

In this light, couici it be suggested that clients' past experiences and self-perceptions at the 
point of intake— considered separately or together— are not always the me\st valid basis for 
decisionmaking? It is submitted that a good intake and asses^srncnt activity should provide 
clients with new and significant information about themselves ^hat would not have been avail- 
able otherwise. To the extent that a client fs aided in life career planning, the intake and assess- 
ment activity is fulfilHng its first objective. To the extent that programs are able to manage re- 
sources more wisely, it has achieved its second objective. 

A third issue relates to the dangers of an informal selection system. Such a systcnvis one in 
which enrollees are selected randomly or selected without regard to rational criteria, su4h as the 
first come, first served method. Clients who are aware of program opportunities, or who happen 
to be standing in line to rnakc application at the right lime, are enrolled, whereas aniSther ap- 
-plicant who may- or may not have better qualifications is not enrolled. Prime sponsors who 
maintain this selection system are not fulfilling their rcsponsfbility to the community to sec that 
the program resources arc equitably distributed. 

Another informal selection system is one in which bias operates to screen out the ;*un- 
wanted'* applicant, frequently found to be the case where interviewers make decisions. regarding 
intake and selection. The interviewer imposes his or her own personal biases on the client. Such 
an interviewer may unwittingly discourage a client from proceeding further or may even make 
a judgment that this individual is not suitable for a^ program enrollment. This may be done at 




the initial point of intake where no r^-cords are maintained. 5n such situations, a prime sponsor 
may he iiriLiware ihai a selection system is being operated. 

A ceneral'description of intake and asscssn^icnt. presented in chapter ! of this monograph, 
examines the elenients of the process. The chapter allows the reader to relate these elements to 
local (actors that have an impact upon program design and performance. A firm grasp of the 
praciical aspects of the intake and assessment process allows the reader to understand how 
elements such as individual client characteristics, program performance standards, and local 
hi:ises may be influenced by the size of the project, interagency relationships, and the many other 
variables thai directly or indirectly affecl <':very prim.e sponsor's program. 

Chapter 2 reviews the literature that seems to provide the most pertinent information rel- 
ative to the assessment techniques available for use by employment and training programs in 
the selection of potential cnrollees. It refers the reader to printed material (see also Bibliog- 
raphy) that permits further individual study of any specific area. By providing a readily ac- 
cessible guide to the literature currently available, it may reduce the need for extensive research 
by program practitioners. 

Variations of program models are discussed in chapter 3, which provides the reader with 
informaiion that may suggest ideas for developing a plan of action. The chapter dem-onstratcs 
.how the elements described in chapter 1 may be combined and what impact these combinations 
have on the programs in which they arc used. Model variations are followed by case studies that 
rcnect current application by Comprehensive Employment and Training Act (CETA) primiC 
sponsors; Although by no means a complete directory, the chapter identifies resources for a 
more dclailcci inquiry. ' 

Chapter 4 briefly reviews the first three chapters and discusses current 'data limitations. 11 
-also suggests areas for additional study and research. 

To receive the maximum benefit from this material, one should readjhe^fifrst and last chap- 
ters with particular care. They provide a good orientation to intake and assessment, as well as 
some basic tools for u.se in bringing about change and development, with a minimal investment 
of lime. The intervening chapters suggest some shortcuts in using these tools, which should re- 
duce the risk of reinvent ing.the wheel. 

This monograph should not be viewed as the final word on the successes and failures of 
CETA programs. It is offered as an opportunity to share the author's knowledge of intake and 
assessment, acquired' by personal, praciical experience, research of the literature, and exper- 
iences recounted by others. In presenting this information, as clearly and concisely as possible, 
-il)c author attempted to provide an intermediate summation, intended to stimulate new ideas 
and challenge readers to refineuheir assessrhent techniques. To the extent t'Hat it realizes this 
objective, readers wiill be madp aware of methods,and models that may be employed to revise or 
develop intake. and assessment actiyities, facilitate enrollee success, and ofi'er other program 
benefits not customarily associated with empioymient and training program components. 

Ms. Lee Bruno, the author of this monograph, is currently on assignment with the Employ- 
ment and Training Administration's Office of National. Programs. She organized and managed 
empioymcnt arid training programs ia Escambia County, Fla., and was director of the Escambia 
County Department of Health and Social Services, responsible for administering health, human 
resources, employment and training, veterans and youth services, and the agricultural extension 
office. Her experience also includes serving on the Employment and Training Administration's^ 
National Work Group on Program Review and Assessment ^arid providing technical assistance' 
in e\-o(Tcnder programs and prime sponsor self-evaluation. 
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K GENERAL DESCRIPTION OF INTAKE AND 

ASSESSMENT " 

) 



Intake is a taken -for-cranted process, so routin.Mhat it 
seldom becomes an object of refinement, which is unfor- 
tunate. Assessment is regarded with suspicion by many em- 
ployment and training specialists as an activity that discrim- 
inates against the disadvantaged. To some people, assessing 
a client implies an adversary relationship whereby potential 
clients must compete to be served. This interpretation is so 
contrary to the philosophy of most employment and training 
programs that assessment has fallen into disrepute, regarded 
by some as a questionable practice. If wc add to this the 
general failure of the science of psychomctrics to prove it- 
self competent to measure people— especially those who vary 
from the ''norm" — there exists some basis for prejudice. 

However, none of these considerations can alter the fact 
that the most important decision made in the course of the 
day-to-day operations of an employment and training pro- 
gram is decided which applicants to enroll. It is this dec:sion 
that determines whether those intended to be served are in 
fact served, and how elftctivcly that service is rendered. 

Although explanations abound for the failure of employ- 
ment and training programs to achieve their goals, common- 
sense dictates that most people have an affinity for that which 
meets their needs. The high drop out rate of CETA program 
enrolices suggests that many clients' needs are not being met. 
As a result, considerable resources are being wasted because 
of the incorrect matching of an enrollee io*a training activity 
or job. Program planners establish a mix of services based on 
their best assumptions about clients' needs. The intake and 
assessment component tests these assumptions, vUereby 
leading the way for program refinement and adjustments. 

It is the thesis of this monograph that identifying client 
needs is an essential element in the development of good 



programs. Intake and assessment are activities where this is 
accomplished. The results have an impact on client success 
as well as the cost-elTectiveness of any developmental pro- 
gram. As a service to clients, it expands their self-knowledge 
and permits more relevant counseling. It can also be an op- 
portunity for clients to test reality in a supportive atmos- 
phere, expand their vocational horizons, and sample the 
wares of the system that promises to serve them. / 

For a training or employment activity to be successful, 
it must be able either to identify those clients who can best 
use its services or to offer unlimited resources, time, and 
money to any and all possible applicants. Since the latter is 
unlikely to occur, it is important that program operators 
examine the rationale behind their enrollment process. 

For purposes of clarification, intake is defined here as any 
process that controls the flow of enrollees into a program ac- 
tivity—such as work experience or classroom training— at a 
rate that maintains optimum enrollment levels. Assessment 
is defined as the process that determines selectivly which ap- 
plicants are to comprise that flow of enrollees. A broader 
definition of assessment would be any analysis of client data 
that. supports a judgment. Because of this close relationship, 
intake and assessment are usually regarded as one continuous 
process. Since counseling is a principal technique for imple- 
menting the intake and'assessmcnt activity, it is also regarded 
as inte:gra! to intake and assessment. Counseling provides the 
client with feedback from the assessment process, with in for- 
relation about employment and training opportunities so that 
a plan of action can evolve. Assessnient (by this foregoing 
definition) is vastly broad in scope. U may be more useful to 
categorize it according to degree of resource commitment 
and the related purposes such a commitment serves,"^ 



/ 
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Level I — Jud^jing Eligibility for 
Admission 

All prime spiin^urs assesses or (ic-crnunc cl'icni t.-liLrihi,.t^ in 
c()mplian.:c wiih I cdcral r-.-quircfncnls. This includes nuMch- 
ing client characicrisiic^v^hh fcdcrjiK mand<iU:d Lnicria. 
\Kc\\ a> an> additir.n.,! rci^ii rcrTi-.:n : established I'ivail', . to 
assure service io :.|-e^ii)c i.:r^':( iiioiiv-- C har.ul.:; ,;ks ,ire 
idcniiticd by using a questionniiire thai is \>i(je!y kriw-An as an 
application or •'iniake'* form. At limes, ihe jssistanee of an 
interviewer is needed, hul usuidly coilceling these data is :i 
simple .-nd inexpensive undcrtakirsp.. The prohlem appc;»rN in 
the pr( cess of analv/ing the data lo make jiJtigm-nl> jhoui 
prio'it;. for enrolln-.ent. The major eonlnbutions made bv 
C--:I A prime spi)nst»rs to the art of incase" a. i J assrssmenl 
hc'.ve hccfi ralinu s> stems to classifv cliirih-.; clients »nti- 
priorit\ croiipN aj..:.-.iinii to need 



.;re neither .-.libn:: :;or ab!;: Im arliLui.^?-: ib<:ir ^lren>!ln-v ami 
•.u;ak^ie^^e•^. l.evei ;:s^c^smcnl j ■> ne(.ess.jr\ •vJ.hcn the pro- 
uran^ ;ipcrcitor has a Aide arra-. ',>f sef. i.es a*, adiible. .is in a 
f T/F '\ program, and nceds lo make a ]ud,;iment <)n *>pe of 
ser*. ice or scr". i'.:es that ".wtiild he nio-.l rvj" ■■(;': la ! to a partic- 
ular chent. 

I- or example, one pnrri'j spnrsor learneo that, in the Mrsi 
*. ear nt (jperatnKi under ^ b. 1' '\ . (j a v-ca re -services '.'-ere con- 
suming? an enormous pr)rtion the services hutJiiet. Ho-a- 
e-cr. a snidy shox'.ed thai m many cases clients could provide 
their ovn day care from personal resources. Dental care, cor- 
rective lenses, and similar minor medical s^tviccs uere areas 
\.herc they I'ould not afu;rd such services. Consequently, 
funds uerc shifted from day-care lo minor medieal services, 
uiih tbiC rcM U (ha; no elienis '^ithdrev*. frt;iTi iraminL'. Later, 
tfic le'. el } assessment ac.ivny siu^Acd precj^eb^ v. here ihc 
needs fnr supportive ser-. ices siiould be. 



Level 2 — Matching Client to 
Activity 

Most prime sponsors must decide heiher elipihie : ppli- 
ca."its are appropriate candidaivrs for the limited services they 
ha olfer. Such an assessment is made to determine if the 
ciirnt is likely to become employable as a result of the serv- 
ices they are able to give. In the second level of assessment, 
data are collected and analy/.cd to support - judgment as to 
whieh applicant amon* :he many should be reierred to a par- 
ticular program activity. The matching of client to accivity in 
ihi.s case would he largely inlluenced by the client's staccd 
preferences and general education. 

Initially, mdividual clients indicate that-ihey need one or 
more of (!) training. (2) job plaeement. or (}) financial as- 
sistance: rarely do they yay that they need anything else. The 
primary sources of data for a level 2 assessment are the in- 
dividual client reports on themsdves (usually collected by the 
interviewer in a slriictured atmosphere) -md traditional aca- 
demie tests. 

Level 3 — Diagnostics for 
Individualization of Services 

A few prime sponsors assess client skills, interests, apti- 
tudes, and other employability factors to obtain a more ac- 
curate match of needs for services. This level of assessment 
invariably involves a wider range of validated assessment 
instruments and structured interviews and questionnaires, A 
level 3 assessment assumes that elieni self-reports are not 
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Summary 

The first level of assessment establishes eligibility for se' v- 
ices. The second level channels cb^nis into program activities 
tliat match either their request for services, education, em- 
ployment history, or interviewers* impressions. The 0 i 
' sel uses diagnostic procedures to provide in\iividual cb- us 
ith meaningful information regarding their strengths and 

•.eaknesses. This gives the rationale for an individualized 
step-by-step empioyahihty plan. The use ot' this procedure is 
more likely to develop knowledge of each client's needs and 
thus enable service deliverers to channel resources more ex- 
peditiously and efTectiveiy. 

Program operators may vary their levels of assessment to 
correspond with a particular kind of training or client group, 
I hereby operating an intake and assessment activity that 
amounts to a combination of the three. An example would be 
a level I assessment for clients enrolling in a summer youth 
program or public service employment activity, a level 2 as- 
sessment for \ elerans enrolling in an on-the-job training com- 
ps)nen:. and a level 3 assessment for illiterate e.x-ofTenders 
with minimal academic skills who are enrolling in classroom 

raining. The choice of assessment level reflects the assump- 
ions that one can make about the clients' needs for services 
and the demands the training or employment activity make 
on the clients. 

So far. client assessment has been treated only as part of 
an overall service delivery mechanism, it can also be used to 
support program management. Data derived from the client 
assessment process will reveal the following to program 
managers: 

I . Types of clients applying for services. 

2: Those whose needs cannot be addressed by current mi.x of 
services available, 

9 
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Three csscruKj; -jt 



Sufliciint f nformati'in 

*rc\: of bir^s i;r "C(jnl.irTi-r,;ii !• 



;a pMicnn:il client V'ljriou^ mccharusms nvs-i ihcn be d^;-::!- 
oped to sfv.uro this ir/(;rrT":.ili(;n ihal '-Mil rn/i itrfccl '.h'.; c'r;- 
}Cclnii;> of ihc inforrnaliori nbt;t:nai I -:>r cxjmpic. if ''n',: 
pro^-rarrt op^criiior >vijnt'> to be sure lh;il people ahH ihe v'cat- 
csi needs jre being served, exlraf-rdinary care -.houlG r;e 
exercised in de lerrnimnv! ihe laciors fhat mflijencc need 
Knovdedge of ihe existence anii de^zrec of an;, c^fllieve laet-jr *. 
tiicn bccome^ relevant in any pariicuiar ease. Tiiis inforrna- 
t!(.)n should be secured by devclopiriLi a structured intervtei-'. 
(Kat phrases ihc questions in such a '.vi:y thai they -.viU nt.-i 
influence the responses. The inter'. lev.er should be trained in 
such a vvay th.{» .-.lyMtude and inter*, ica techniques v.ili result 
in object jvjtv . 



'\s essential an element as the first, cost-effectiveness eon- 
stder-.jtions are significant in es\ablislung a sound prograrii. 
C ost mciudes use of agency resources, such ir-. 'A;\^\ and client 
time, as "jvel! as merely making sure there is enough mone>- 
The nctd::d irTormation must be obtained at a cost com- 
mcnsurale with its value.; e.g., sophi.sticated levc! 3 a^scss- 
mcnt would not be v^orth its e(3si to most summer youth wt^k 
experience projects.. 

Al limes, cost may be shared by several agencies, thereby 
increasing cosl-elTeetivencss for the prime sponsor, f-rc- 
quenily agencies such as local health departments are wiliin^^. 
10 participate in such a collaboration because their goals are 
served by providing medical screening ic di^advaniaged 
people who lack preventive health care. In some cases, nor.- 
tinancial agreements have made possible complete physical 



p:.rr:e rr:;;:?.' .^s> t r-er-i-^ci"- es i f;c'< 



;f>: .^n^: uSNe}s->rrier^t So be sh;ife^* f^v 

;i;<;-ri: :v ^V'^>:rl in- V. c iruj .^^ ..rn^n? rcsjv^nsi- 

licirrnMi:-: ^he re^:"-o'!sir^;e en!it;. idcijUv. .'il i'^ncjes 
r^.jr'v.ir-aMru? ;n 'nr^ endca^' : \%"u!d m ::ccep5(' the au- 

thority of ';ne a;:eri-. In si.rne instances, this avicM the 
prirrie ^p'^nsor, in •.:;:her^, ;t c.tn be the subcon •. ratjn to the 
p::n.'t: spons(;r. A^-'ericy interr:j:cine can becrimc i prv>h!ern if 
iM'wd phipnin^. cornmun:catr ace: uni^^bditv. .;nd njon- 
i!'.-riry,' ar-; not adrrwHisira' ively feasible. In addition to the 
.!dvant:igc shared cost, a rnulli-ajien cv a^ses-rncnt ac^.'-aty 



Function of the Assessment 

f he tinrd element function or purp^^se of iisse'^s ment- 
is the end to which all assessment is a means. Whenever an 
assessment aciiv;iy ser-es more than <jne purpose, it is naid 
to be mult ifu net lonai. As previously stated, client assessment 
yenerallv supports erpr!<)ymenl and training actsvi'./ by help- 
ing 'riatcls appropf'atc cbcnts to appropriate activities. It 
i ser- e other functions of either client service or program 
management naiure An example of the latter case, cited 
earlier, is proj^ra?:: evaluath)n v. herein a client's einployabil- 
\'\ is ne»'iC'dicaily monr'orcd again- the initial asses "^ment 
results . 

Client assessment should be a client -centered activity: it 
cannot be jusJifjed as striclly a program management tool. 
There arc many ways thai intake and assessm.crit can be ben- 
eficial a no supportive to a client, nf5t the least of v^hich is 
providing evaluative information to clients thai enables ihcm 
to make belter JudgmcnLs about themselves. Assessment 
shoutd be done >n conjunction \^iih clients. The failiire of 
stall members to share a sscssm.cn t data with their clients 
could be a reflection of the slafl's insecurity as a change 
agent or ihcir mahility to reiale to the clients. 
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2. VIETKODOLOGV 



r"'^onnci !t -a:} -, probably h^:;c ?h.;: :hc ^vc^ikncssc^ of these 

advent o( rn:.x1crn rchabJhlation ijgcr?c:c> {'n:ii ^-nk vs:*h 

s-irnptinj* as vvcil -t^ oihc; := ^vc-^isnK?"* icchn;^^:;':'. hcc-mc 
more orgafi;/ctf 

T?ic Tcsitrtg Oficn'ation and Work l-v^tb^jUor? in Hrrhvibu- 
i?.:iUun ITOWLR) ^y-slcnu developed by Ihf; In>tJU;t(.; fs)? ihc 
( rippled and DiSijblcd in Nov York Cuy ':n ;hc I9?n'>. 
A as fhc sy-.tci^aUc :ndiV;t1yah/c"J approach ^> vocaUo^nii 
cvaluatiof^ t'n.u v^.js not (leper. dcn^ Cft pap<:r',^Rd-pCP.cU ccs?- 
mg, Smcc then, the Jcv.i«ih F.mplovmcni .:nd Vi>cahon::i 
Scrv/ccs iiccatcd in Phiiadciphui), shroygH contract wiin 
the Dcrartmcnt of t^ahor. drv'clopcd an cv.iiuatjon <y^tcrn 
th:j! basai jpon %v'jrk sarnpling Indus'ry h^is also; contr jb- 
iiicd the Singff :'<^«*..:J^:cij. "^ysJcm for -^ork cv;ilu;inon 

Toward ihc end uf ihe f!=?50\. ^omc of the icchnurucs de- 
veloped to jssos cn^phyv fTKnr pi^icnhal of the h\ind\c:ipr^-:il 
bci?.ir: ?o he arr^^JCti on j sfnull scale to dis4dv.»raai:cd wOfk- 
cfs. LiifKC crj)r-i*>'''<^^^ developed a>sc^srncn! tccbn?>jue.> 
of dilTcfcn*i kjnds lo -dcntjfy potent i:d anivine ci-ccuttves 
tfowcvcr. the vjnof.r-. St.iic dcp:i?t?ncn'-'^ of voi-:r-onal rc- 
habiiitaOon rcmam ihc mosi progresses', c cniiiics in cxpcf- 

ihc^c pracuiioncfs have noi generally contfibtHcd to av;iiUiblc 
lacfaiurc. Vet the -^pcficoco of vocatiori;*; rch;jbiiaaUDn 
agencies could 5crvc as a rich resource for p^tncsponst>r>li3lT 
mcmbcrvvfcho arc exploring as!>cs5meni techniques ilvu ihey 
can use wiih ihcir <j'vn cnrotfce^. 

A^^wmcnt tccbniqucv cur) stcncr^ly btr grouped a** foU 
lovvs: (j) Tests. (2) inetfvicus (somciimc:^ fcfcrrcd lo as 
"coun'icUng"). O) the hisiorical. or case study, nppfoach, and 
(4) obscfvalion l:ach i$ icviesved here if» terms of i?s applica- 
tion tocmploynicni and training programs 



1 CblS ' 

u>?i;u^ v^rsnc^nl^ .if-.d rr,;u-hv:v- „irc nn>;cc* such 
cvvfiU^r.-cr^y 'h;?! jI i> bcy^;ri<i the hrnji.itjya^ o( ?h;> rr^onb- 
^■r.^ph lu advivc iht ?:^der cot«rnjng .iricrn. Instead. ?hjs 
vccuon sun\maf5/es the ?no(e frecucnUy li^ai tc^>[s. ;md. -Ar^cn 
po>:;^iblc, includes ?dcv;ini conuncns^^ ptitnc xpi>nsor >. The 
v.q^j:\l t- niploymcnt Orj><>rU;n;5y Conunlssion (HHOC) >:?Hdc- 
lines., vartou'^ Anicncan Psvc^u^togicai Associatson si^trsdcirds. 
iiv.d ihc Buros Afca^f^''**^?'^*'^*''^ Yvarhnak (sec Bib- 

ij^^^^rcr-'.ys arc ^^^^ptoot iM guides for sclc-^smir. 

I here arc uirce vwi?:ciies of tests- ( I ) PajH:r L>nd ;H;ncj|, (2? 
projective, and (5) wofk s^rf*u(al)ons f:isuaU> caHcd "-Atirk 
>anf'p:c't"' or "%i.otk cvaroatson"** ■^ys^cnis) 

(MDTAi and other caicgiifical crvipioynicnt and uainuig 
programs, program operators discovered uku uadUionat 
tc^<s ufjfc no: >i3it:;r>(c r«-»r nir?st ^.d their d^s^jdvantaecd cIk^h^ 
'.cic Tradusona^, u-sis arc itt;ficraHy pap<;r-and-p^ncJi proce- 
dures fcrrtmiscent of classroom >:xaminijUcn^ an unpleasant 
ctpcrjcnce so the ?ncmory i:d' cnrullccv Often thi: lan^»siattc 
of the ic^ts rs not familiar tf> ihc cnroilcc*;, or ic dcals in >tib« 
)cci rnalSCf usth .vhiirh fncy have had r?o prcv^oiis ^^p-eticn^c 

Some cuiiuroi may not consid<if scores on'?c5is i\s faiing ■ 
high vvahin ihcir system of vahics BnroHccs from such cut- 
tufes arc not motivated lo do ^^di on a tcu. ?n one cxpcf- 
uncnt v^txh New York City ^nrolke^. diircfera fortn^ of ihc 
same test were i}sc4 lo measure acadt^mic pr -rjcicncy in rc^sd- ' 
ing. Ian^ua;gc .skills, and math After ihc fust ^c^iing and^ 
'.viihoui intervening, insiruction, a second form {he ^^v: 
test was administered and cmolkpi^ ucrc olXctai ^naiici^d 



iru cr: !^ Nt' >.5r'n!}v;^n( i JiipjiK ciiu-n! ]:\ rht.')r U'\\ scores 
I hf.- 5(>!i]- •,^,$•v jii.t? .icuhrn^!., S'-^^rv^ .t^i:r.i«:cd a' one 

■.'.ul 0:r .)h!^l^!t;•^^ t;? c;- i {'ii? r M K uhilc failure 

■vj s?ijrujar{ii/i'ii . I ;i-.\. i}r cr. :ricaM>fc^ cniplov ahi hi •» 

tftusjni! tcshui^ .sit*y,»clhVr hi^lc.-al. (iicv cniplov suhiccliw 
J u^iv^vfU*; as to uhith r « 'lice .::-:!n receive the hcncti.l 
fr- -"trajhif^a: or cm sijcvV-cd rir a parlicixiar job. Other Dp- 
crahWK c\..'}nin?cU ihi.: siijiul if di/cd icsis lo see lun\ thes l<>uUI 
.he jfTipr<»ved \ir iuvA new K'sN eould be desek>ped th;M would 
:^pc a^^uraic aCvOun^, ■ ai{ ^;:ui5V tdija['> piilcnUa! (or k 
ox irairrtTty.. Yht-. secUiui d)^cli'^vc^ ^iandafdi/ed tests thai 
h\r c bc.en iouiid i^^ctul and. Jndicale^ m which Mli;;iiii)ns ihcy. 
nia> be ti^cd li' .ld^M^UJl:c SonK' -)! Uie stai'.dardi/cd tests 
'.f a-:hltua,dK 'a>c -.^ere rcvic'. Cil fieeau^c thcv have a litniled 

U-at n:a\ n-^: he k:u'-.^ri j." pFtJirir :ifT] opcrau-rs aru! Eiia? ^ecrn 
:->'^!:cT TTi:^rc iv>U:!^f>ai (oi enr<dSec evaluation 

he \| itlndc Te-.t Hatier> i(iA I Bi, developed h% 

? filled' Sla'.c- ! -I'l^lrnrDcnr Service M 'Sf-S). in (>ne of thc 
Hvst ^)^c:^■'arc- i:ener.il icarrMHi! ahdit\. ■>eri>al aptitude, 
nuipetica; . !' :'' ■:> ^ -^pevjal aptJiude. K>rn] pereentK»i\. clerical 
perccphoii. ;:i.»iof ctiordinauon. hni!er dexterity. ;t:;d n:an!;ai 
<iC\icrUy »\>r indtvidiiab who are funeijoning between the 
NpJh- aiui iwcfJtlj'-ijrade !c\els ,\etualiy. experience of pro- 
<»pcf itti^rs jji us^jfu? this in>irunicni has shi)wn ii to be 
irfo>t valid w}-jcn u^ed wjth indiNadualN who have cc^rVipieied 
5hc'tcfUh In tuelnh grades lis validity diminishes at (the 
hjt'her r;rj iowcr levels Without anv firm ayrecnicni on what 
'\i\thM!raiie iever' reters u\ program drnmistrators should 
HtU use It wid) an\o!ic who ha.^ not conipleted the tenth grade 
of.hijJili seh'-i^.d; Oiie C'iTA pnmc sponsor uses the GATB to 
ni^Se*-. » i»cner.d tTUelhcence antl vocatii^nabrelateci skilK of 
ifuir" iduais c^n^nni! wn^^ ihe cluvic ^^ho can funcli(in at the 
ejv!hth^i!r:ii.;c rcadjr*!^ leve!. aecordioi: to .the C'aiirornia 
Vchievenieni I csi i( \ \ i Si.jll" nieinbcr.s :did nut t.ind the ■ 
(iATB to he parueularK helplui r- any (HV* perlorniinc at 
a }o\^ er erade ie- el ' 

. F'lie ('ai;r<^nia Aciiicv efucrii Icsl a coinniori"hie"iis.ure oi' 
readinn. ueahul;ir> , and arithmetic skills that relates per^ 
iofmar^ce to ^fade-level equivalents. Since most classroom 
{rainjni: pro^jramN reijuire peneral education at a certain 
ur<rdc level lor\ aiimiSMon. the C A l' has obvious usefulness. 
Unforiunnlelv. test norniN are at least ten yeors old so thai 
when the person's pcrfoKXKince is related to a grade IcycL it 



IN lit that enide level averrged ten years ago. Its advantage is 
il'iat It can be adrniiustcreci to a izroup of people and is ihere- 
lorc cllicienl . 

I he nonverbal portion of the Lorize- T'horndike Intelligence 
I CNt is {-^ict^inal. Jiai^rafTiniatic, or numeral. Since it assesses 
an r.bsiraci abdii> ;o learn, it is not alwavs helpful in meas- 
urini: abibty to learn relevant job-related skills. The exper- 
ience of the fiscambia County (Florida) prime sponsor has 
been that this test is not as helpful ii^ the revised Beta (a pcr- 
tormance-orienied intelligence lest) which > used along with 
"the n.ATB. The revised Beta lest includes areas: 

1 Nbthl v U) pay attention, to plan, and U) use foresighl. 

? \bilit% lo perform repel ilive tasks that involve new learn- 

ir.'/and short- term niernor) . 
.V Abstract conceptuaii/alion skills. 
4 Capacity lo perceive sp»alial relationships. 
."^ Ability lo diirerentiale essential from nonessential details. 

Vis'jai discrimination tests that measure clerical skills. 

.specti. and accuracy. 

Individuals who have good verbaUskills but low perform- 
ance skills probably will not show high scores on the reyiscd 
Beta lesr because ii erhphasi/es performance skills. On the 
tuber hand, those aiih low verbal skills but with adequaie 
preformancc skills will tend to show high scores, k seems to 
be an excelk: : examination procedure f(^r clients who have 
poordanguage capability! ' 

' rtjc Strong Vocational Interest Blank has application only 
lor persons who have college-level educations. Since il must 
be matrhine scored and is expensive, it may not lend itself to 
common Usage. ^ ~ 

The Kuder Preference" Method is mentioned here because 
It is in such frequent use among secondary schools to measure 
occupational inicresi thai^ it is frequently adopted by em- 
ployment and training program operators for use with the 
disadvantaged. The language of (his test so limits il use ^ith 
such populations that program operators are discouraged 
with the results and are disinclined to use it. The test is rather 
i IS didiculi Id score» and is expensive when machine 
• '.^red - ^ 

The 1^5- Occupational Literacy Test (BOLT) measures 
reading and arit^Hmctic skills of the disadvantaged. It has 
the advantage of being able lo measure these skills at a low 
academic level while still appealing to adult interest. This 
test could be helpful lo a program operator performing 
level 2 assessments to determine whether the individual can 
benirbi from a training program thai calls for a specific skill 
level in arithnieiic and reading. 

I he Social Access Questionnaire (SAQ) measureTsix-pej- 
sonalttv factors and includes quesiions^aboui personal his- 
tory. Its purpose is to measure social, and personality char- 
acteristics that contribute to job deviance. Designed by the 
Nfanpower Laboratory of Colorado State University, It 
could aid in determining those interventions necessary for 
successful training and job placement. 



The non-reading Apliludc Test Ballcry (N/M BUv^an cf- 
Ibrt lo adapt ihc (iATB l\)r use ainonLZ the disadvantaged 
population with limited reading skills. The U .S. Ilmploymenl 
Service also cieveloped a brief screening exercise that con- 
tains a fev. (iATB sample items to determine whether the ' 
C;ATB or NATB would he the test most appHcahle io a par- 
ticular suhject. Although the research on the NATB is not 
complete, it is sullicicnt to suggest that this is a useful assess- 
ment device to measure potential for training. 

There are other paper-and-pencil tests, such as the Interest 
Check i.ist. dev'elopcd hy the U.S. Employment Service, 
which list occupations that the client may check in accord- 
ance wiih his or her interests. The success of this instrument is 
dependent upon the client's reading skills and a general 
knowledge of a wide variety of occupations. It isy not used 
successfully with younger clients or individuals who have 
limited employment history. Jt is possible to use "d^Centcr- 
ing** ■ to develop a similar checklist for clients being consid- 
ered for local training programs or jobs. 

An advantage of paper-and-pencil tests is that thc\^ tend to 
be more objective and easier to administer tharT^ire other 
assessment techniques. ,Many times they can he administered 
to large groups, whereas the othwf»««4*iip^ of tests cannot. 
Many of the papcr-and-pencil tests can be machine setired. 
which also adds to their ellieiency. 



Projective Te^ts 

Projective tests are usually reserved for measuring per- 
sonality fa<;K)rs. Any projective test cliIIs for a client to he 
bright. imagjtY:iiiNe.* and verbal. The extent to which such 
tests can be uscfuPb^ part of an assessment depends upon the 
likelihood that {hcjc char\elerislic.s can he found in the 
clients. Self-Cont?^ts Profiling, a pictorial test, measures 
work attitttdtrsof the seriously disadvantaged, Clients are 
asked to view pictures of people in work situations and talk 
about them. The subjects then calegori/e their own responses- 
and impose \ at own structure in eonccptuali/ing. , A psy- 
chologist of conjiiderahle skill is recjuired to aid the client's 
participation in this test. It is time consuming hut probably 
no more so than an unstructured interview. 

The Minnesota Multiphasic Personality Inventory (MMPi) 
is a clinical instrument that distinguishes between neurotics, 
psychotics, and **normals.^f Used foj^sclection purposes in in- 
dustry, it is highly regarded internationally as one of the best 
researched instruments currently in use as a measure of 
erhotional stability. The iestj:on;;ists of 550 statements cov- 
ering a wide range of ^'Uhject matter^ The client is asked to 
sort staleinents into one of three categories: ''true.*' 'Talso.*' 
or *'cannol Nav.'* All forms of this test'can be used with lit- 



erate subjects over the age of 15 who have al least im eighth- 
grade reading level; thus it has stmie limitations for many 
m a n po w e r cn r ol lees . 

Some test-taking sophistication is required; otherwise, 
the test is fairly easy to administer. Its construction elim- 
inates tests in which too many answers are not appropriate 
for the person taking the test; i.e.. the score can indicate 
whether it has high relative validity is invalid because the 
subject has suppressed or misrepresenled certiiin materials in 
her or bis res[)onses. 

The Minnesota test has the disadvantage thai it can be 
used only by qualihed psychologists. However, a psychol- 
ogist lit less than a doctorate }e\el can use it il" supervised by 
a person with high qualilications. There is danger in using 
this tesl:as a sole basis for a diagnosis of emotional stability ■ 
it should be used only to support data Irom other assess- 
ments, particularly interviews and observations. 



Work Simulations 

Probably the assessment device that ^is developing the 
greatest popularity at this time is the use of work simulations 
(or work samples) to evaluate work ptUential. Work samples 
such as those developed by the Jewish Hmployment and 
Vocational Services are .ineant Jo address problems as- 
sociated with paper-and-peneil tests; namely. Uiat such tests 
measure an individuaPs vocabulary and reading sk more 
than anything else. The >\ilue of a well-constructed work 
sample is that it can measure persona! characteristics that 
relate to training or job success as well as the client's 
trainability, |r ■ " V 

The use of work slTmples grew out of the ellbrts of re■^^ 
■ babilitation agencies to work with the physically and men-^.^ 
tally handicapped. The work sample is a simulated work 
experience that' relates directly to ineasurements of job- 
related skills as they arc demonstrated in practice. Bn- assess- 
ing the performance and time required hy the client to com- 
plete the task, the client's work potential can be compared 
with the norm for the various sample tests. Tlie chief dis- 
advantage of. a 'work sample is that it depends greatly' upon 
observation and the interpretations of the observer-assessor. 
The assessor using work samples needs speciaf skills, 

Although training is available to provide stalT members 
with these skills, it is not included in the usual university cur- 
riculum. The- other disadvantage of a work sample is that it 
entails expense in setting up a laboratory that simulates a 
variety of work experiences. To operate an assessment center 
that includes work samples, one must have: (!) Sudleient 
lime, to put a client through a work sample. (2) qualified 
stall who can understand and interpret the behavior of the 



■ '■r)cccnicrinp"*i« ihc process bv uhich vocabulary and rc:idinp levels .irc altered u» tu a spci'ifiv 
vulture. Thi'i i<i js-complnhCT} hy usinji ;is translators members of the t.irjjct popubtiDn >*ho arc 
bilingual -iH.it n. (amiliiir with tcrm^ used by both the .middle class and disaJvantaKcd jiroups. Ti> 
check to 5CC if the iranilaiion is ct>mplete. a second bilnaual ardup is invited ;ti interpret its nic;ining 
toscoCit accurately reflects the oricmal diKument rbis iv ;i practical method U)t use m dc>clopin8 
application fnfn^v.chcckliMs. and interview Cthedulo 



Appendix n IS .1 dctaded vuidc 1or conducJinc :i hchavioi.il asNcssrrccnt developed by Gri<»duill 
Industnes of South f'lorida. tnc Although ni)l felevjnt tn cmplovmcnt .md traininc procrams, it does 
demonstrate htm tme pri»cfam operator formjili/ed the bch.iviriral assessment that invariably occurs 
during intake iind .issc^sment. 
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client engaged in a v^urk sample, and (3) ample space to ac- 
commodate a work laboratory. These real costs seem lo dis- 
courage many einploymeiil and training program operators 
from employing the work sample approacli. 

(On the other hand, there are a great many advantages. "I he 
properly selceled work sample can provide the most valid 
information on bow a elient is likely to partieipate in training 
or proeeed in employment, it avoids measuring unrelated 
skills such as vocabulary and language when they are nob 
direetly related to the occupation sampled. It refleets no cul- 
tural bias. It has an educational elTect on the elients in that it 
introduces them to oecupations with which they may have 
no familiarity or exposure, thereby suggesting career oppor- 
tunities they had not previously eonsidered. 

Seven packaged w ork samples are worthy of some atten- 
tion; The McC •arron- Dial Work fcvaluation System, the Jew- 
ish hmployment and Vocational Sc^rvjces (Jb!VS) system, the 
Singer Voeatuinal fivaluation System (Singer/Graflex sys- 
tem), the Talent Assessment Programs', the Tower system, 
tbe.'Vulpar Component Work Sample Series, and the Wide 
Range Hmployment Sample Test. All are discussed in A 
• Comparison of Seven Vocational Systems by the Stout Voca- 
tional Rehabilitation Institute, (listed in the Bibliography). 
Anyone considering purehasing a packaged work sample 
should read this document before making a choice. This 
secLioif reviews only three ofthese-work samples TOWER, 
JEVS. and Valpar because of their known use in employ- 
ment and .traiiiing projects. 

The TOVVFR System. The TOWER is mentioned here be- 
cause it has the longest history of use and is considered a 
pioneer etTort in the field of work sample.s, TOWHR has been' 
used extensively for elients with mental and physical dis- 
abilities and has earned high praise among rehabilitation 
ageheies for its predietive value Mowever, research does not 
support some of the testimonials. It requires 5 to 7 weeks to 
complete. all 110 samples. Since the Work samples ai;c not 
individufilly packaged, a program operator would have to 
purchase the entire system to use any portion of it. For these. 

. reasons, the TOWHR has cost liabilities. If assessment of 
ertffttionally or physically handicapped, people is important 
to a program, it would probably be advisable to consult local 
rehabilitation agencies, which may be u^^'ng work samples 

. for this purpose, and^purchase special assessment services a*- 
needed. 

The Jewish Hmployment and Vocational Services System. 
JEVS developed a standardized set of work samples through 
a contract with the Department of Labor. This evaluation 
system has been used to assess more disadvantaged pe.rsons 
than has any other work sample system. As of 1972, 35 prpj^ 
ects, including 12 WOrk Incentive (WIN) Program uttIj 18 
Concentrated Hmployment F^rogram centers, had adopted 
'the JHVS approaeh. The extent of current use is unknown, 
The JEVS work evaluation system consists of 28 basic assess- 

' rhc SinBcr/Ofaflc* »\*fcm rcquirr>> <iome icsl «>ophntik.atinn One prime sponsor familiar \nlh Ihi^ 
methiKi dfc»f>(it revommcjul i( li w f.tthci c< p«n*i»c hciausc tonsidcrahlc materia) cannot be rcutcil 
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mcnt samples that represent 10 worker trait group assess- 
ments of occupational catagories taken from the Dictionary 
o f Occupational Titles, Its chief value is in judging areas of 
interest and competency among the clients, The work sam- 
ples are all self-contained in carrels. The entire system re- 
quires 3 weeks to complete. Since adniinistration of the sam- 
ples relies upon audiovisual and programmed instructions; 
fewer staff can asses more people than is possible with other 
systems. 

The Valpar Component Work Sample Serces. Valpar was 
initially developed for workers injured in industrial accidents, 
it contains 12 subsets that measure skills in dealing with: (1) 
Small tools (mechanical), (2) size discrimination, (3) numer- 
ical sorting, (4) upper extremity range and motion, (5) cler- 
ical comprehension and aptitude^ (6) independent problem 
solving, (7) multilevel sorting, (8) simulated assembly, (9) 
whole body range of motion, ( 10) tri-level measurementv( 1 1) 
eye, hand, and foot coordination, and (12) soldering. Each 
sample can be used separately andjs individually packaged. 
It requires 12 to 15 hours to complete all of the units. While 
training is available, this system does not require special 
training for its administration. The ease with which it can be 
administered and scored is one of its most attractive features. 



Interviews 

Scheduled interviews are' also a form of assessment. A 
scheduled interview diiTers from an unstructured interview in 
that it relies upon a written format to guide the interviewer. 
It permits some flexibility to accommodate the personal dif- 
ferences pf interviewees. 

An. interview schedule has other advantages qver the un- 
structured interviews that are commonly^ the basis for as- 
sessment in most manpower programs. A guided, structured 
interview reduces the number of extraneous variables that 
would bias the information gathered. Remembering that an 
essential element of assessment is valid, unbiased informa- 
tion, one should limit the use of unstructured interviews. . . - 



Case Study 

Biographical data p/ovide a valuable assessment tool. The 
Biographical Information Blank has been used extensively 
by the Jobs Corps to predict length of participation in train- 
ing or job tenure in the event of placement. It covers nine 
major categories, some of which may be found in traditional 
application blanks. Other categories concern feelings, at- 
titudes, and value judgments. 

The^purpose of this instrument is to determine whether the 
client is a good program or employment risk. It has also been 
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used, by State Employment' Security Agencies and among 
WIN participants to determine what intervention stratejcies 
may be necessary to maintain their enrollment. 



Observation 

Not to be overlooked is observation as an assessment tool. 
It is often criticized as being the least objective of all rnethods 
of assessment. Despite some truth to this criticism, client 
behavior monitored by a trained observer may provide some 
of the most effective measures of client motivation, interest, 
and ability on the grounds that the best predictor of future 
behavior is past' behavior. During the period of assessment, 
the client observed to be on time, to be attentive, cooperative, 
"eager to p^^^^ and able to follow directions is likely to 

exhibit the same behavior in a training program. 

Although measurement of^behavior is not a difflcult proc- 
ess, analysis is another matter. A client who js inattentive, 
frequently absent, or late may reflect lack of interest in the 
assessment process, fear of being assessed or, anticipating 
failure, a casual disregard for the whole affair for ego protec- 
tion purposes. On the other hand, a client may bave been kept 
awake by a sick child- night after night and had other prob- 
lems that bear no relationship to motivation. Howe/er, some 
take the pointtof view that the ''why's" behind the b»^havior 
arc unimportant. Poor attendance has the same efTect'on the 
training process when it results from lack of interest as when 
it i^ the consequence of poor health. Understanding the 
'*why\s'' is generally necessary, though, when an intervention 
strategy is available and under consideration. 

'S^ ... • 

Choosing and Using Assessment 
Methods 



This chapter is designed to give the reader a brief overview 
of what assessment instruments are available and what their 
limitations are. The information presented is not intended to 
be sufficient for firm decisions concerning the choice of as- 
sessment- instruments. For further information, consult 
Methods of Assessing the Disadvantaged in Manpower Pro- 
grams (see Bibliography). Readers interestedjn expanding 
upon the interview as an informational device should read 
Worker Traits Training Units (also listed in the* Bibliogra- 
graphy). For assistance in quickly surveying all 'of the assess- 
ment instruments currently in use, refer to Appendix C, 
^'Summary of Assessment Tools for the Disadvantaged." 

Good assessment tools and trained stafTto administer them 
are essential requirements of an effective intake and assess- 
ment activity. Some of the assessment devices,/particularly 
thr- work samples, offer training for people purchasing the 



materials. Training in the use of paper-and-pencil tests is 
included in advanced postgraduate work in the field of psy- 
chometrics. All of the tests mentioned here probably could 
^^bc-^administered by a psychometrist at the master's degree 
lcv,el who had a qualified p.sychologist at the doctoral level 
available as a consultant. The training required for use of the 
USES-developed tests, the GATE and the NATE, may be 
obtained through the local SESA. office. Generally, projective 
test.s^ call for a higher degree of training than do the non- 
projective tests. In contrast, the trained and skilled observer 
may have only a bachelor's degree ^vith^a major in psychology 
that is behavioristic in its orientation*. 

. Good interviewers possess, by virtue of training or innate 
ability, i^igh degree of sensitivity and awareness of self. 
Self-awareness is an essential characteristic of all. assessors 
because they tend to project their own personality, attitudes, 
and bfases on clients. Recognizing this inclination is the first 
\^step toward curtailing biases of those giving the test. Anothjer 
recommended approach is team assessment, allovying per- 
-sonal biases" to canceKeach other. The team approach to 
evaluation is one in which each team member uses difTerent 
methods to gain information. To the extent that the team can 
agree in overlapping areas, validity is enhanced. 

In addition to valid assessment tools and trained personnel, 
strong linkages to other program components are critical to 
intake and assessment. The goal is to provide valid informa- 
tion tjiat is sufficient for clients and program operators to 
make judgments concerning the distribution of services. 
Therefore, the assignment to a particular activity or service 
should be the joint dc ision of the stafT person who will be 
held accountable for the program results.and the client. 

The nature of the linkage between intake and -assessment 
and other program activities determines whethef. intake and 
assessment are regarded as helpful or are resented. by staff 
members of other program components. Unless the assess- 
ment unit is to be held accountable for program outcomes, 
unit members should not decide on enrollment. Usually, 
client a'ssessment is held to be-.an area of specialization, 
whereas tl\e client services component is in the hands of g^n- 
eralists who-assume responsibility for caseload mar.:igement 
and the implementation of a plan for services. Assessnjent 
should not imply selection; it should prpvide input to tjeci^ion 
makers. The relevant decision makers are, first, clients^; and 
second, the staff responsible for program results. ■ -f * 

Often overlooked is tfie 6pportunity for feedback |:o the 
intake and assessment unit concerning the accuracy/ of* its 
predictions. Once the client has been assessed and enrolled 
in a program activity, seldom does the intake and assess- 
ment unit hear anything more. A constant feedback into *the 
intake and assessment unit would allow its members to re- 
adjust their procedures or alter their approach. Without 
feedback, there is no positive change. It is exth^ely impor- 
tant that intake and assessment units see their roles as sup- 
.^portive of other program activities, since that is clearly their 
.function./. * ^ '* ~. " r. 
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3. DESCRIPTI07M OF VARIATIONS IN THE 
PROGRAM MODEL 



In the earlier discussion of ihe essential elements of the 
design of an intake and assessment activity, it was stated, 
"that the first element concerned the kinds of data sought, 
which could be categorized into three levels according to: 
(I) The intensity of the assessment process, (2) how the activ- 
ity is rhanaged to maximize cost-effectiveness, and (3) 
whether there is one or more than one purpose of the intake 
and assessment process. By combining these three essential 
elements, one can evolve nine possible intake and* assessment 
models, reflecting the level of assessment, the extent to 
which it is multifunctional, and whether it is managed as a 
product of one or more than one agency effort. These nine 
models are illustrated in the matrix* in chart K The models 
id.entify essential elements of an intake and assessment ac- 
tivity and are designed to help ihe reader structure his or her, 
thinking on thesubject. 

I 

i Chart I. Istakl an'd AsshssmhS-j MArRix 
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Legend: 

A = Single function, single agency. 
B = Miilijfunciion, single agency 
C = Mullifunclfron. nnulliagcnc) . 



One should keep in mind that level I, 2, or 3 refers to the 
intensity of the assessment process: function refers to a 
primary purpose, and single agency or multiagency refers to 
the number. of agencies that contribute to the intake and as- 
sessment process. To the extent that these elements can be 
identified, one c^n determine which of the models is currently 
being operated. This.chapter describes in detail variations of 



the models and gives readers an idea of the available options 
according to their particular ci-cumstances. 



The Single Function, Single 
Agency Model ( LeveJ 1 ) 



The level i model is used by prime sponsors whose priority 
is to determine eligibility as quickly and as inexpensively as 
possible. Assessment is conducted at the level I activity by a 
•structured or unstructured interview that involves completing 
an intake. or application form. It uses the data collected for 
no other purpose than to determirie eligibility or priority for 
enrollment. It is operated by one agent/-tisually the prime 
. sponsor or an agency uijder contract to the prime sponsor. 
Because of the simplicity of its design, the planning, manageT 
ment, and monitoririg Activities can be handled by. the same 
supervisory personnel. 

The internal structures are simple, since a single agency^s 
staff is involved in conducting assessment. The prime sponsor 
operating this model reflects the philosophy of accepting 
clients on a fix&Kcome, first served basis. Although cost per 
participant will be the lowest^f all models, the overall pro- 
gram costs niay::be inflated by high turnover among clients 
incorrectly matched to training Activity. Since a prime spon- 
sor must examine total cost for achieving successful job 
placement, this will be an iniportant consideration in using 
this model. It is especiall^^ true of indirect placements when 



■ To simpiify ihc discussion, a centralized tniakc'-sysicm js assumed. Obviously, intake could be 
arccmptishcd by several employment and training apcnct'x (i.e.. contractors, subgrantccs). The "single 
aecncN** *oLild be ihc CETA prime sponsor. j 
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labor nuirkcl ciMidilion^ :nc not condsiL'ivc U) easy phiccmcnt. 
WliL-n labor viciDami is hi^^'i. ^''^^^ [^oorl\ served lIi-.mUs aiul 
uiisucccNsriil Irainccs nutv he al)lc lo solutc |oi-rs. 

This nioiicl IxMiclils pai iici|\anls I'crtnitl inu llicm rL;ul> 
-acL-ess lo available prourain NcruccN. ( )pc.r.itinii mkIi a nioiici 
can best be iuslilicd h\ small [M ini.c sponsi>rs ibal have only 

' a limilcci ni]nii)cr ol clicnls and a limited niimlKT o\' prouram 
activities available lo them. I bis is the most ei>mnK)nK used 

assessment procedure lof siimiiier \nulb employ {r«enl pro- 
gram's, when time is a Niiinilieani.eonslr^iinl upon'assessmeni 
aeliv ity and services are usually limled lo work experience. 

The validity oj" these assessments dcpendii upon tlie pro- 
fessional judument of the inlerv ieM cr responsible for helpiVii:; 
the client complcie the application vVi^ritlicr i'orni.s. Ofcoursc. 
: the accuracy^'or the client's sell'-repons^rtcrmines lh.e"-c\tenl 
[o which this information is reliable and valid. ' ^ 

Cjcnerally. the results ol" programs that operate this mode! 
are: (I) fligh dropout rales or non^osiiivc icrrninalions. (2)/ 
low et)sl pgr participant served, with p^iore [)artieipants being 
• served in order to replace those who dfop out. and (3) high 
cost per placement. 'I his' rnodel . is pojXilar witii botli par- 
ticipants and program operators; Progruni operators like it 
because it is simple to admiriisler and re!alively inexpensive 
in terms of short-range objectives. Participants like this 

.model because they iiiove quickly from, the status of an ap- 
' plieant to one of^an enroilce. which is their short-range ob- 
jective, it. is only in long-range outcomes, such as success in 
■ .training programs and training-related pla'cements. that the 
disadv antage of this''nu>dcl is fell. Because of the many events 
occur/ing between intake and assessment and icrmination, 
the responsibility for ibc failure of .the prti^ram or the client 
is seldom related tiV the intake and assessment activity . 
. The New ^'o^k balance-of-State prime sponsor has devel- 
-■ oped an innovative tool for determining eligibility: it- dem- 
onstrates the level I single function, single 'agency model. 
^Within the balance-of-Siule jurisdiction, ibere is an employ- 

•ment and training otlice responsible for intake and asse.vs- 
nicnt in each countv. The county oHiee completes an applica- 
tion form on each CBTA ;vpplicant and then may apply a; 
' ''priority profile matrix" (sec appendix A) to develop a score. 
Scores indiealc^he extent of need on the part 'of the individual 
applicant. Those applicants who have ,the highest scores are 
referred to the subcontractor for training or. in the "base of 
public service employment, are referred to t-bc empioyin'C: 
agcney\for select ii)n. The prime sponsor as.sumcs no assess- 
ment responsibility beyond this point .leaving fmal selection 
of the apph\^ants to the individuie^ubeontraetor. 

• - This is anVxample of a level 1 assessment in operation, 
unusually refined in that a matri.x converts client charac- 
teristics into" a nuliierical code that can he combined into an 
overall rating of thL\*ligibilily of each. client. This instrument 
addresses one of the fis^quently cived problems among prime 

- ?^*rwrs. fn view of the ebgibility requirem>-hts and the prior- 
'■' ity classifications identitiiH ^^'^^ prime sponsor, how does 

. one decide w hom to enroll wHien the number of eligible people 
ci^ceeds program capacity aad represents a variety of dif- 
ferent target groups? The New Vork halance-of-Statc matrix 
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ail dresses this problem l)y quantifying these characteristics 
s(^ thai the\ can bccombmed in^o a total se^^^re. 

Die iiilormitlion secured through the intake ;ind assess- 
ment process is used only to delermine who should be ac- 
ce|Meii \'or serv ice. "Miisjs not uncommon in balance-of-State 
*"|Mojcets where the areas being served may be sparsely |)op- 
iriateii i)V^ noncoruiguous. with ievs resources to draw upon, 
h Wv'Uld still be advisable that some as.sessment aciivity at 
level 2 be undertaken, even in tho.se instranees when there 
arc more needy eligibk persons available for training than 
I here arc training slols. liven in smalT iialance-of-State dis- 
irict^, cost - eiycctiv eness is a consideration. With limited 
lesourccs. it becomes even more importa-nt that clients., be 
i:arefullv screened so that hich turnover can be aVoided. 

/ 

The Multifunction, Single 
Ageeicy ModeM Level 1 ) 

■ This model serves some functions in addition to eligibility 
determination. The assessment process is linked, (o some 
other service or program benetil. Possible program benefus 
may be. for example, the use of ^la regarding client digibit- 
ity for a research cirort or a Federal reporting requirement. 
A prognfm director could use a mult il'unet ion model to in- 
crease the benefus for tl^ prcu.ri: m management and the 
client without signilicantly increasing the cast of collecting 
data. Although the level 1 a.ssessment activity does not pro- 
duce a great deal of data, it can. be helpful in pro^ iding.lbe 
information to support the management iniormati)n system 
that will eventually produce tiic Federal reports. 

Getting the ^^maximum use of the data calls for careful 
planning and some expansion of data collected. The man- 
agement of this. system calls for well-constructed forms to 
colleei the information and a How chart tbat'allows it to be 
used for other designated purposes. Monitoring this model 
entails reviewing client data for accuracy as well as dcter- 
min'ing io what extent the infbr'.i:*tion is used for its intenSett 
purpose. Since the model' call • for no addition in stalT and 
only^ a slight increase in the complexity of the woTk, coor- 
dination would not seem to be o problem.. To the extent that 
the function served involves other agencies, there would be 
some need to coordinate activities of the assessing agency 
w i'th those of the other agencies. 

There should be little increase in cost and thcrclbrc greater 
eosl-elTcctivencss over the previous modcL To the extent that 
the use of the data produces satisfactory results, this model, 
can be said to be a good one. One of its disadvantages is that 
it produces limited data. Gelling maximum use of the limited, 
data would be an advantage. Many prime sponsors currently 
are using level i assessment activity, incorporating a single 
function model. Converting it to a multifunction model would 
■be a way to' get more use from the CFTA dollar without a 
major transition. 




The Multifunction, Multiagericy 
Model (Level 1) : \ 



This model operates at a lovd 1 assessment aciivity, 
servcs-^more than one function.' and is jointly .supported by 
morelhan one agency. Tiic basis for any multiagency model 
is a- collaboration of several community agencies that have 
agreed to make their individual contributions to the assess- 
ment process in return for shared benefiis. Sihcc this model- 
only determines eligibiluy for admission lo a program activ- 
ity, it is unlikely that many agencies would be interested in 
it. In addition, the cost of level I assessment activity is not 
going to be so great that the prime sponsor would seek other 
encies to share expenses. Such model presents many 
riiagement problems because- of^' the 'division of labor 
amoy-g several entities. . Hence coordination becomes "a 
greatjpr problem. There is considerabte risk of breakdowns 
in ^^mmunications among the agencies: thus this model 
rnay pr^xvelt)^ a greater administrative burden than its in- 
tended benefits are worth. 
^ The only advantage of this model is that getting other 
agencies to share the cost of eligibility determination in- 
crea'ses the cost-efTectiveness to (he prime sponsor. . h is 
recommended for, use only when the participating Ugenciefs 
have a history of successfully coordinatin,r^ ihuir cfTorts with 
minimal management problems. 



The Single Function, Single 
AgencylVloc^ei ( Level 2) 



Because of the increased complexity of providing some 
measures to determine who will be suitable for enrollment in 
any particular activity, the stafT for this model must have 
some special training in test administration. Since there arc 
more tasks to perform, there must be more statT people to 
•perform them. This increases costs per participant. How- 
ever, the likelihood of a^ssigning clients to the appropriate 
activities is^greater. and turnover should be reduced. Place- 
tncnt costs should decrease. 

Planning of this model calls for: 

1. Determining which characteristics a client should possess, 
not only to be eligible for enrollment but also to be suc- 
cessful in the program activities available. 

2. Identifying which information . is needed to document those 
characteristics. 

3. Selecting th^e instruments and procedures that will solicit 
^ that information. - - 

4. ApppintingstafTpeople whocan administer the assessment. 

^freedback becomes important in this model because it re- 
quires that predictions .be made. Monitoring the accuracy of 
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the Dredictions should be constant. This may be accomplished 
by follow-up reports of clients' success in training or in place- 
ment, which arc reviewed by the assessment staff and com- 
pared w:ith the information. collected. This calls for a mon- 
itoring process not needed in the level 1 methods. 

External coordination takes on greater import^pce, since 
il'is essential to the monitoring process. Internally, coordina- 
tion is complicated by the structuring of the assessment proc- 
ess into specific tasks delegated .to individual staff members. 
TKese people, must coordinate their findings and work to- 
gether in tiie'^ssessment of a particular client. Scheduling 
tests involves coordinating with other staff person*^ who are 
also scheduling tests for the same client. It is possible, of 
course, thai in this level of assessment a single staff person 
may administer' wnattiver measures are deemed to be of 
value. In such a case, coordination should not pose a prob- 
lem. * % 

One consideration in deciding oil this mot^el is its possible\ 
adverse effects on/clients. Generally, people do not enjoy any 

' assessment jjro. 'ess for fear they will, not do well. It is possible 
that clients v'ijl be screened out as a consequence of the in- 
formation obtained durmg intake and ass ess iVient. They may 
then be inhibited, by fear of similar rejection, from seeking 
other employment and training programs that may be better 
able to serve their needs. Turning away clients tvho have 
completed an assessment process reinforces negative feelings. 

.toward agencies that serve tfiem. As a result, they m^y be . 
discouraged from making further attempts to seek vocational 
objec^ ves. This effect must be weighed against the results ' 
for clients who are better matched with the training or em- 
ployment-activity and hence succeed. The model differs from' 
the level I single function, single agency model as to the time 
when ihc client experiences failure— at Ihc time of assessment- 
or in the course of training. 

In Summar^'; this model is far. more supportive of the train- 
ing and piaceme"nt activity than are the level 1. models, but it • 
may not be perceived as helpfyl to clients who were rejected • 
as a consequence of the ^ssessment process. It increases the 
cost of intake and assfcssVnent, but reduces placement cb'sts. /t 
It is more difficult to administer than are level I models. 

The Broward ManpowWr Council in Florida .is a con-;^ . 
sortium that represents one county and two municipalities. 
The council hr.s three locations for intake; in. addition, it. has 
a mobile van t^nt is scheduled to be in_ various cornmiinities 
•at,^rlain times for the purpose of intake. The entire intake 
and assessment process is managed by prime sponsor.staff — 
therefore it represents a single agency- model. The intake 
process in the Boward consortium begins by having a poten- 
tial client comptste an application form\^one of the intake 
centers. There is some general orientation for the client ait- ° 
this^ time, and the Psychological Corporation's ABLE test 
(which assesses academic skilh in reading, vocabulary, and 
math) is given. The*test is dcsigred to appeal to the culturally 
disadvantaged adult. The scores can be converted to grade 
equivalents, which enables the Broward consortium staff to 
deterrpine if the client's choice of training and occupational 
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objective is commOnsuraie with her or his academic back- 
grou-icl. The ' li-^nt, along wilh the lest results, is then reierred 
to a counselor. Ihe counselor assists the flient in coniirrning 
•his v: her vocational objective or. when this is not appro- 
priate, in selecting other goals. 

There is also further orientation at this phase of assess- 
ment, with structured and un.structured interviews being the 
source of most of the information. In the event that the coun- 
'>clor feels t^urther testing is neci:r,sary, the client is referred to 
the sivAT psychometrist,- who may*apply any of a number of 
additional assessmt;nt instruments." 

The results of these assessments allow the counselor lo 
determine which particular program isjiiost appropriate for 
the^^client. If there is no opening in the appropriate program, 
^he client's name is placa^' on a waiting list until such time as 
he or she can be enrolled. Although this assessment process 
includes the use of a variety of sophisticated instruments, it 
is important" to note that most clients receive a9ademic as- 
sessment only. Thus, thi^ process represents a level 2 as- 
^sessment for most clients and a level 3 assessment for some. 
One psychometrist and a nuipber of counselors comprise the 
stafT, making this a fairly inexpensive activity. 

There is some prejudice against tests of this nature, an(' 
some communities may accept their use only in this Hmited 
way. Not getting' corusislent :dala on every client limii.^ the 
many functions iht information could p<^ssibly provide. For 
instance, Broward County has only one function for its level 
2 assessment: the proper assignment of clients to appropriate 
training or employnient activities. Although there is some in- 
formal referral to other agencies, it is not considered a func- 
tion of the assessment center. 

The BrowuTd Manpower Council is operalj^ng- a level 2 ' 
single function, single agency model. It could very easilV;; 
move 'o A level 3 assessment by expanding its stalT and, as- 
sessment services. 7 he cost of this might be prohibitive if it 
continues to meet only thelsingle function of client services. 
In the event that it can use the information gathered for other 
functions and purposes, the extra cost could be justi'fied. 

The Multifunction, Single Agency 
Model (Level 2) \^ 

In this model, the assessment data are used for purposes in 
addition to client enrollment, thereby supporting a multi- 
function goal. At this level of asses^mcn*., program operators 
would have some knowledge of the nature of the clients they 
could not enroll. ,iin invaluable tool. Thus, one function that" 
may he served by this model is program planning. The rela?- 

•V number tif^'Kul ;lSscs\me^^^)^lIs j,rc .i^jiiuhlc ihc rcM\cd Bct.i, ihc dilfcfcnhal .ipmiidclcMv 
ihc Binct H.indhifit l>c<tcni\ Tc>l. th<: C f><Aford Smjll {'jrix lie^tcriU Tc-it. ihc Short l-mptovmcnl . 
ItM 'SI Ti< k»itjil -Vrtitudc let. ".he Uorvdcrlut Personnel le\1. Ihe Kuder Preference Tevt. iHc 
<(CiMM f'ulufc t'/lcfc>! Invcndir-. ihc suiern f'er\on;ilnv I .n.u»f\ tc\t. \he Vptitudc fnr 'NiffMnc 
\ <.im the I •rfzi \'K.ittMnjl Sur'f'. ihe Perxoincl Test lor InduKirv (PI t| Ttvi of Vbilitv U- ^•»l 



tionship of the assessment activity to the planning process 
would determine how this model might be managed. Multiple 
centers would have to^have one central data collection point, 
which would have an mVpact on the management information 
system. 

The coordination of this model d'*pLnds upon how many 
center.-; arg collecting the information and how n^^uny sub- 
contractors muy be using the information. It is unusual for 
anvagcncy to share its information without sharing the cost, 
of collecting the information. Therefore, it is reasonable to 
assume thai this hiodel may serve multiple funclions, but 
they will be funciidns that are determined by the pririie spon- 
sor, li IS conceivable, however, that the level 2 as.se<;sment 
activity could collect data related to adult education pro- 
gr-ams. which the pririh; sponsor copld make available to the 
local school board. It would be a generous prime sponsor that 
would meet the information needs of afi outside agency: how- 
eyer, it is something to be considered. ^ 

Because of the higher level of assessment activity, this- 
model is more expensive, than level 1 models. However, the 
increased cost of collectmg the data js ofTset by the multi- 
function aspect of the model. In the final analysis, cost- 
efFectiveness should not be a disadvantage in operating the 
model. _ . . • ^ ^ 

Yhis model will have the greatest i^npact on the comirmniiy 
of those considered thus far, It is in a position to make omer 
agency resources available to the participants by functioning 
as a referral' service. It has the advantage of belgg reasonably 
inexpensive to operate while olTcring many benefits to clients 
and program operators. It does r^ot require staff skills th^t 
exceed* those available t|0 most prime .sponsors. Becaus(i it is 
a single agency op^f*^ti^n^ it requires minimal externid and 
internal coordination. r 

Montgomery County, Md., operates a levd 2 multifunc- 
.tion, single agency model. AVith the support of a substantial 
number of other community resources, Montgomery County 
is able to serve alj who apply for job-related training. The 
intake and assessment component directs eligible lipplicants 
to appropriate services that correspond to client needs. It is 
used also as a means of collecting data to support program 
review and adjustrhents. , 

The .Montgomery County level 2 assessment involves cer- 
fication of eligibility at the reception center. An intake form 
is completed and reviewed by an assessment counselor, who 
.also [ntcrviews the client. These techniques solicit^ infirma- 
tion regarding past training, education, work hi^torv . per- 
sonal data, and client vocational preferences. 'If/ the clients 
are determined to be job ready, they areVeferred to the place- 
ment unit. Ifjob training is Indicated, thje assessment coun- 
selor recommends a vocational area and refers the client to 
the employment counseling uni^. There, an employment 
counselor engag'^-s tbe client in further interviews and may 
administer the GATB or other tests that are prerequisite to 
acceptance by particular training institutions. Based upon the 
client's self-reports and test, res'ults, an employ/ability plan 
and training request are initiated. ThJ^s prograrri operator 
may. refer clients to any of a variety of training facilities. 



Tests are used more \o determine whether a client is ac- 
cep»ifble to the trainer under consideration rather than to de- 
cide upon a vocational choice. The client's past history and 
interests generally* deternii/ic vocational choice. This imor- 
malion is obtained through interviews afler the client has had 
the opportunity to review special literature on occupations. ' 

The Multifu!iciion, MuItiageTicy 
Model (Level 2) 

This model would j^c likely to he found in operations where 
h'j:veral ag,encies have agreed tha: the data derived from the 
assessment process would be mutually beneficial and ihefeby 
warrant a joint endeavor to achieve shared objectives. ATi 
example would be 'an agency specifically designed to accom> 
modate needs not met by the prime sponsor. This agency 
could have an oii^Ueach recruitment facility located al the as^ 
sessment center. Tile prime sponsor benefit.^ in that it has 
some alternative to olTer. clients"- who cannot be en. oiled, 
namely, the services of the other agency. Providing access to 
such;iiltern'aiives is wise from a political as well as a human- 
itarian view. > ' . ^ 1 

As stated earlier, ihe more information gathered in, the 
course of assessment, the greater the probability that assess- 
ment can rserve several purposes. This, in turn, makes it an 
attractive joint venture for other -agencies. Thh model calls' 
for thoughtful planning because it offers many possibilities 
to the prime sponsor. Lach potential use of data must be 
weighed. . 

Of course, the management of a level 2 multifunction.- 
multiagency.model entails- more stalT training and more mon> 
itpring of information flow than do the models discussed 
earlier. When several agencies are cooperating to conduct as- 
sessment, supervision is a key management issue. Having 
staff reporting to a different administl^or poses pecliliar 
problems. This can be avoided by giving one agency total 
respoVisibility for the activity and subcontracting with the 
other agencies. However, the reluctance of many agencies to 
relinquish control over their staffs poses a problem for any- 
one operating this model. 

In some cases, the assessment-process can be divided neatly 
into sectors, with each^agency being allowed a particular sec- 
tor to manage. The results of the assessment process are later 
coordinatetf-'in one central office. This information is then 
divided into shar^g uniLs and redirected to the appropriate 
agency requiring it. This process probably requires a more' 
intricate management informatiort system and more time 
spent in planning the flow of information thf;n do single 
agency operations. There may also be problems in maintain- 
•ing control over access to confidential information. ^ - ' * 

Iftvaridbly any milltiagcncy model is going to entail some 
management time* spent maintaining good communications 
and a high level of trust among agencies. This model cannot 



function well if the agencies involved are not committed to 
the same objectives. 

Although problehis of, coordination and management are 
disadvantages, better cost-eiTeetivencss is a key advantage of 
this model-: A level 2 assessment center is less e.xpensive to 
the prime sponsor if it meets several, functions and shares 
cost among several agencies. In many instances, this model 
provides the only means whereby a prime sponsor is able to 
get involved in a level 2 assessment activity considered neces- 
sary for good program results. 

The Metropolitan Baitirr'.ore Consortium consists of the 
City of Baltimore and five surrounding counties. This sizable 
urban employment and training program uses a level 2 multi- 
function, multiagency mocfel but allows for a level 3 assess- 
ment in special cases. The Baltimore consortium provides 
intake and some level 2 assessment through its fifteen man- 
power service centers. Four of these centers are contained in 
•mobile units' operated by the prime sponsor. Six are subcon- 
tracted to the employment service (with four of them jointiy 
funded by the employment service and the prime sponsor), 
and five are subcontracted to community-based organiza- 
tions. Manpower service centers^ receive appjicalions for 
CETA-funded training. Aft(^r eligibility has been established, 
a serii'ice center m'^y provide either "direct job placement or 
assessment to determine an appropriate referral to one of the 
training contractors. ■ . 

Jn addition} to the multiple intake centers, there are also 
multiple triSning contractors. Eligibility criteria for each 
training program are set jointly by the prime sponsor and the 
training contractor. The'manpower service. center provides a 
level 2 assessment for determining appropriate referrals for 
training. This assessment includes counseling interviews and 
testing in math and reading. The Job Corps reading test is 
used id determine reading grade level. Level II of the Wide 
Range Achievement Test (WRAT) math sectipn is used to 
measure a client's math grade level. Decisions regarding 
training and job referrals are based primarily on the;; coun- 
selor's holistic assessment of the' client (prior education; 
avocations, physical health, interests, previous work exper- 
ience, vocational training, and'so forth). Set in this context. 
ma4h and reading grade levels are seen, as two of the many 
factors to be considered. 

Two clients are referred Tor each opening in accordance 
with agreements with the training contractor. The purpose 
of the level 2 assessment is, to eiTect an approximate match of 
a client's training needs with services available through the 
training contractor. The high volume of applications ,de^ 
mands that testing be as brief as possible at this point. Once 
clients have been referred for openings, the training con- 
tractor may administer morjc tests and ft^rther screen them to 
select appropriate enrollees. The Psychological Corporation's 
Fundamental Achievement Series is a commoif test used by 
training contractors. • ; 

When the service center identifies clients^equiring individ- 
ualized services before^becorning employable, it refers them 
to the Baltimore Goodwill Industries. Inc. This agency 



serves as another training contractor, with specific emphasis 
on the hard-to-scrv : client. This more comprehensive .servij;o 
package'includes a level 3 assessment, loilowed by a highly 
individualized plan for services. Such services may include 
work adjustment, job readiness, vocational training, sup- 
portive services, and job placement. 

The Baltimore (iood^vill Industries, inc., uses the Hester 
Vegas System to provide a computerized printout of client 
characteristics, using the code numbers ol the Diciionary of 
. Occupational Titles, It may also conduct some psychological 
testing, vvork sampling, and exposure lo the Singer/Granex 
evaluation sy.stcm. Its V^e-^itipn-j) Hxploration Guidance AS" 
sessment involves an exposure^to a number of difTerent work 
areas/ followed by an in-:i-pih interview, A vocational evaU 
uation w ith these methods mav take three or four weeks. 

Baltimore has developed a process that meets the following 
ideniilied neecjs: (1) Service to a high volume of clients in a 
densely populated urban area: (2) screening for appropriate 
referral to training and job placement: and (3) providing^s-er- 
vices to especially disadvantaged and liard-to-serve enrollee.s. 

Data from the level 2 assessment conducted by the service 
centerir are fed into the Baltimore Management Inlormalion 
Systeni (MIS), where they hecomcv.the raw data for Federal 
reports. This information is also used by th.*t Baltimore con- 
sortium's research department as a basis for study of client 
placements. Thor^^e, the assessment process not only pro- 
vides clients with an appropriate referral to training but also 
supports the program's research eHorts and reporting re- 
quirements. It is classified as a'multiagency model in that the 
Baltimore model provides its assessment services with the as- 
sistance of the employment service, which in some cases con- 
Uibiiies personnel and other resources. 

The Single Function, Single 
Agency Model ( Level 3 ) 

The primary dilTerence between this m6del and those prev- 
iousiy described is the extent of the assessment activity, A 
level 3 activity includes a full range of diagnostic procedures 
that serVje as the basi.s for a plan of individualized services. 
This should be undertaken only when a number pf services 
and activities are available-to clients. The process involves 
the use of a wide variety of assessment instruments, the selec- 
tion of which is based upon an analysis of information needed 
to correctly match clients to available services or job oppor- 
tunities, Because of the cost associated with this activity, it 
is important that the prime sponsor carefully analyze what 
information is needed to avoid collecting data that will have 
no relevance to the services or activities available. Obviously^ 
every eligible client cannot be given an extensive assessment 
because the cost is prohibitive. Prescreening is usually ac- 
complished with the help g'f structured interviews, group 
counseling sessions, ih-depth orientation to the program, and 
use of rough indicators of general education. 



Because of the sophistication gf the assessment process and 
th^ test measures to be used, a large and well trained stafT is 
required. A level 3 assessment activity precludes the possibil- 
ity that any one stall" person can independently complete the 
eiUire diagnostic |)roccss for the client. This means that a 
number ol stall members mu^l function as an assessment 
team. -each relating to the client, in his or her particular area 
of expertise. If the team approach is properly used, the stalT 
will have overlapping jireas that will allow for checks of 
^biases that tend to atiect validation of the data collected, 
y Interdependent team members require greater attention to 
coordination than do stafi* functioni^^g independently of one 
another Clients mu.si he .scheduX^j' for interviews, tests, work 
samples, and other assessments so that each member of the 
learn has the client availablc/whcn needed. This requirement 
Vor internal eoordinaticni/f clients and team members is one 
of the disadvantages of/a level 3 assessment. If it is not well 
managed, ehis proces.-i^can be prolonged to the despair of the 
client and l-ie frust'.alibr^ of the program operators awaiting 
the informiiijon. f-^ 

Monitoring has the sam- importance to this model as it^ 
: did to level 2 models .-Feedback on the accuracy of all pre> 
dictions and relevancy of data must be directed to the as.sess- 
.ment unit. Since there are more data involved, there is a 
greater need foV increased feedba. '. 

The materials, stalT, and time inv(., ed to complete a level 
3 as.sessment greatly increase the cost per participant as- 
sessed. However, because of the validity, availability^ and 
scope of the data obtained, it should reduce the cost per client 
successfully served in a program activity or placed in a job. 
The kinds of level asses.s^ment tools commonly used are 
interviews, aptitude and interest tests, work evaluations, at- 
titudinal measu' . social assessments, and physical exam- 
inations. The increased cost is likely to discourage any prime 
jjpon.sor from operating level 3 assessment alone, particularly 
when it serves only one function. The cost is likely to exceed 
the benefits, 

A level 2 a,sse,ssment usually involves the paper-and-pencil 
test, whereas a level 3" assessment probably includes this test.- 
\plus more, struclurcd i^ucVviews, projective tests, interest 
tests, social assessments, and physical examinations. None of 
these additional 'as.sessments are likely to incur resistance 
among clients since they relate primarily to concrete behav- 
iors and generally involve one-to-one client-stafT relation- 
ships. Clients are less likely to feel that they are competing 
with otjiers in their groups and can enjoy the special attention 
that the process afTords them. The increa.sed assessment is 
unlikely to result in more people being rejected than would be 
found unsuitable by the level 2 assessment (although physical 
examinations may revear di.sabilities that would prohibit 
clients from participating in training activities). 

A level 3 assessment may be resisted by planning councils 
or elected ollicials who are prejudiced against **fancy'' tests, 
especially when they arc administered by a psychologist. 
Many people view such testing as having the implication that 



menial aberrations arc suspected. Ihe layman also niav be 
unaware ofllic usefulness of sonic of the more sophisticaiai 
assessiiienl tools and may resist spendinu money in this wav 

rile overall adviinlaue of this inoik* is thai it provides llic 
mo.sl helpful kinds of infoijtialion loiZo\ern selection ofscrv- 
ices and irainini?' ac!ivit\ for a particular clieiii. lio\,cver. 
v.hen this kind of asscssnicnl is incorporated in a model that 
has onl> one function and is operated by a sinulc auencv. the 
cost is iienerally prolii[)iti\ c. 



The Multifunction, Single 
Agency Model (Level 3) 



sponsor is operating an information and referral service, 
linkages hf:t\scen the prime .sponsor and other agencies must 
he cll'cctivc. lO evaluate benelits to tbc chcnt. the sponsor 
uould have to determine that the client, when referred, re- 
ceived :-.o;iie beiieiits (hat he or she could not have received 
iust as uell uitluujt the referral. This uotild entail fdllowup 
i monitoring the referrals. 

A chief disadvantage of this model is thai the expense- of 
operating a level 3 assessment activity is almost too great for 
a small prime sponsor, ll i.s unlikely that any prime sponsor 
cruild iiistily the cost of this model solely in ticrnis of meeting 
ils program objeclives and goals. MoweveV. a manpower 
planning council could justify an information and referral 
service as a general support to the labor market, going be- 
vond those people who \sill hecorr.e CUT A enrollces. 



'This model provides a lull diagni)stic analysis of caeli par- 
ticipant. It can he a great sources of information for fulfilling 
other program function.s, The prime sponsor wouki use this 
model in situations where t4ie community lacks an adequate 
information referral service and the planning council eon- 
siders it to he the C[-T.A program's responsibility to provide 
intensive counseling to unemployed people, including those 
that it will not he able to enroll. One service that lends itself 
to lhis model is counseling in areas such as health care and 
domestic. relations. 

Because of the extent of the level 3 inquiry and the dlua 
available to pinpojiji real needs, information antpi^eierral 
services are more beneficial to the client than rire' those re- 
sulting from morj limited assessments. Similarly/ an agency 
is more likely to be responsive to a client referred to it, he- 
cause of the quality of the material supporting the referral. 
This model provides immediate service to the cliehl in the 
eomnuinity in a measurable, way. Other agencies are hen- 
eliled by having case histories' and some diagnostic informa- 
tion a\ailable to them. 

• Of course, planning for the operation of this model sug- 
gests consideration of i number of faetors: 

" I . Selection of assessniLMt instructions. 

2. Selection of stalfio c ndi: Jt the assessment activ-itv. 

3. How.ihe informati.m. wnc of which is highly eontidential. 
can be used., 

4, Hdw this information uill be ! ransfcrred from the assess- 
ment center to the user agene\ . 

5, How information can support other .-^rncy activities, 

Monitoring this model requires greai care in reviewing the 
aeeuraey of the information initially eolleeted and even 
greater care in Iriicing its use b\ participating agencies t(v be 
assured that it was not misu.sed. ' 

The management of this model presents distinctive prob- 
lems. The schedulipg of the administration of tests, counsel- 
ing interviews, and so forth must he coordinated carcfuily so 
that eliepls are available to the various assessment specialists 
when needed. iMorcover, the management of this model re- 
quires that the ilow of information be eontrolled/lf the prime' 



The Multifunction, Multiagency 
Model (Level 3) 



Of all the models so far discussed, this is the most com- 
plex and ditlicult to operate. However, since il is a muiti- 
agcncvjiiodel. expenses can be shared by collaborating agen- 
cies '\w a way that may make it cost-elTeetive for all conr 
cerned. A lc\'el 3 assessment aetivity provides ample data 
to accommodate many purposes and therefore ofTers more to 
a greater number of ageneies. This model ofTers the most to 
the GOmmunity and to the client. 

hi planning ibis model, one should lirsl consider the kinds 
of inlormatioii required in the assessment process in order 
to serve the function of individualization of services to ihe 
client. Second, one must think through what other functions 
could be served by multiple use of the same information or by 
a slight expansion of the information. Could this information 
he used as a basis for a reimed information and referral serv- 
ice? Could it he used as a means of monitoring client change 
and therefore the elVecMvcness of program activities? The 
planner should give thought to other agencies ibat have sim- 
ilar goals and an interest in the same client population. If a 
welfare otKee has a commitment to serve lqw-inco,me mothers 
receiving public assistance by rehabilitating them for eventual 
self-support, it would have some of the same information 
needs as the prime spon.sor. 

Planning would not only identify these agencies but also, 
based upon their needs, would expand and refine the level 3 
assessment. They would need to have input regarding a share 
of the cost of the assessment process and the extent to which 
they could. commit resources to this end. This would be the 
basis for a plan for the management of the model that would 
take into consideration the extensive need for monitoring to 
assure coordination and timeliness. Any level 3 assessment 
can he time consuming, and caution should be exercised to 
see that the cHents are served expeditiously — a greater prob- 
lem when more than one agency is involved in the process. 
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Monitoring should also lictcrniinc uh.ji cllccl the nioilcl (s 
hiiviny on the client in terms of pcrcei\ci] benefits. If the 
managcrneni plan ealis for each agencv to contribute Mat!" 
rncniber> to perrorni specihc aNsessnient activities, sonic one 
pcrM)n or aiieney inusl be assiuneii the rcsp()nsibilit\ iar man- 
aiiement Direct lines ol eomnuiu ication >houk) be estab- 
lished and specific duties of each stall inernb<.r. lacludiriu tljc 
assessment siipcrvisor. spelled out m x'.ritinL'. '['he use be 
made of the- infornKition should also be agreed upon. In this 
regard. dilTe ring urgency philosophies and policies. come into 
play. Sonic aget/cies may ieel that no inrorniation tW^tamed in 
this process ean he used to present a clicn'. I'roni taking ad- 
vantage of the prime sponsor's serv ice. I'he prime sponsor 
may wcw assessment as a means oC sercening people for 
training and employment acti\i'iics. Such con(licl^ \\ould 
have to be resolved in the course o{' the planning ol ibis 
model. 

The. tradeolF is the model's <:ost-en'ceti\ cncss. A highly 
sophisticated and expensiv e assessment process can be \silhin 
the financial reach ol'any prime sponsor iT a sullicient number 
of agencies in- the community are '.villing and ab»c to share 
the cost. Agencies that generally share an interest in serving 
^the same clients as the prime sponsor uou'ld be the local vvel- 
farc departmeni. the employment s.er\ ice. and vocalional 'rc- 
habilitation agencies. This model provides a tnosl ed'ective 
basis for an informalion and referral service that prevcrrts 
clienls from being shuttled from one agency to another with- 
out follow-up. It p'^events inappropriate referrals because of 
•inaccurate or insufficient information. This model's greatest 
advantage' is thai it provides the com m unit), vsitb a coor- 
dinated information referral service that is capable of (obtain- 
ing the most suitable agency st^r vices fur the client. Its dis- 
advantage is related to its complex linkages, both internallv 
and externally. Skills in planning and management are re- 
quired tt) maintain such a model with success. 

The F.scamoia County (Fla.) prime sponsor is 'an example 
of a level } multifunction, multiagency model. Tliis is sur- 
prising in that Fscambia is a smali prime spt)i'isor \s:th a Title 
1 grant of approximately SI million annually. Evscambia 
County^ maintains a leviM 3 assessment system at a cost to the 
prime .sponsor of approximately $68,000 per year. 

Intake is contracted to the Florida State Hmploymcnt 
Service, which interviews applicants, to determine eligibility 
and referral for cither employment or training. Those ap- 
plicants referred for training are assembled in group.s'for pro- 
,Uam orientation and prescreening by the assessment center. 
A California Achievement Test locator c.xam and brief para- 
graphs written by applicants arc examined along with ap- ' 
plication forms. Since the assessment center is also .in infor- 
mation and referral service serving State health and rehabil- 
ilalive" agencies as well as CHTA programs, selection of 
Clients to be a.'^ses.sed provides opportunities for services that 
exist in .several difTerent agencies. For example, if Ljiere are 
no openings for CLiTA-skiils training but there are openings 
in the remedial education class, clients who have the greatest 
need for these services would enter the assessment center. 



(1 tents \Mth severe hantiicaps \souid he en roll ^jd as potential 
Mjc;»lfonal rehahilil.!' n clients. 

The assessment process recjijircs approxiin.Meh/ ivsi) \seeks 
to c^uTiplele SlatT .unsisis i;C {i; \ lull-tur.c nur.e and a 
[Xirt-linu: f)iivsiCian lo v. 'iducl pfi>sicat exainmahniiN. {2; a 
psvcliulogist \vno administers the Ntinnesi)ta MultiphaMC 
Persorialilv Inventory (NiMPIj and revised Beta, m .iddition 
10 pro\iding career c(Hinscling. (3) a \sork e^alualw: who ad- 
mmislcrs the Je^sish f-.niplov mcni and Voc.::ii;nal Services 
uork evaluatu)n ot' each clicni, (4) a teacher who conducts 
acaJenuc assessments and monitor > simulated classroom 
situations to further determine the clicnTs academic aptitude, 
and (5) a vocational rehabilitation counselor who ser\es as 
overall .supervisor of the|init and assists the client m making 
bnal career choices. The \'ocati(jnal rehabilitation counselor 
also refers ciicnls to CJ'.T .A training or some other agency 
that. may provide them \sith needed scrvic<:s and follows up 
on the referrals. ("Iicnts receive.! no stipends hile underizoinc 
assessment. ^ 

The inforinalion obtained through this intensive assess- 
in cut process provivJes the diagnostics that establish the 
basis for the em ployability plan and schedule for individ- 
uali/eti services. An advantage of having various staff each 
perform a ptjrtion of the assessment, rather than one psych- 
ometrist do all of the assessment, is that it allows for biases to 
be canceled out. The assessment team members meet to com- 
bine their assessments df each individual case. The resulting 
file of data and conclusions or recommendations for services 
is shared 'with both the cirent'and the training counselor. .\{ 
I flat pciini. the role of* assessment ends. The client and coun- 
selor revieu the data aiid formulate an ent'ployahilitv plan 
that meets the apprtnal t)f the client and the program man- 
aj-'cineni. "I fiis plan not only spells out vocational objectives 
antl training activities, btil also outlines the supportive serv- 
ices retjuircti. * 

Evaluation, Monitoring, 
and Referral 

A number of functions other than assessment are served by 
the same -information gatfiered on- clienls. One is evaluation. 
l:scamhia County evaluates its training programs by review- 
ing the baseline data. collected on the ne\s' trainees every 90 
days to determine what changes have occurred in the em- 
ployabilitv factors, assessed. There are 20 such factors eval- 
uated during the assessment process. Kach is reviewed by the 
training coortiinator to determine vWiat cllange may have 
occurred during the days t)f service delivcr<^. This assess- 
ment is again repeated at the time of termination for the 
client. These r^vievss cn;!ble the prograrli ev^iluation unit to 
trace changes among all clients on a regular basis. 

When some clients seem to be progressing a long -the factor 
relatinii to academic proficiency but not in the areas of 'phys- 
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ival \n)p:\\z{/\cni. proi!r.jm npcralors c\jTn:n(.; ihcir pro- 
iirurn U>Tj>'cj\'h At tlic sLiRic ls?:iC. .tn inii;vt<l.jLi| cliynTs 

prt>i!''c'^ in .'.!} 2^"» <.5CttJf> c:ir- hu ... >nip;»rc<.i with ihc 
in'vl(\'-x pr-Ji'fc^s li" ibis •.■•as JicrU -Aho seems l-? i-, ni.ik.nu 

t!Uj^--' }s ih.il !l rcuu!fcs st.ifT iwi^c to icc^.jiu.i;c li(C '. .jri^us 
cnipii^N i.K{')rs cvcrv ^)() -.l.t^v fhis c.ilb for^i rcpciili^^n 

o!" ihc .iN^cssnK-ni prt)x:css rcjss'j-.s the vhcnls or .i ludtniicra 
on the pat ' ol" the c;i>cio.^vi rn.irv.iviL;r .i> the kind proizrcss 
ih:\\ h,u hccf^ niadc '( Luicr i> Ic^s precis:; hui .idmin- 
iNlr.Lfi-.cK 'Ti'^rc {c,i>{hh: ! o ihc orient ih;U ihcsc Hncrvcning 
measures arc rclia^^le, a consis;crii nKMsure o( program av- 
tjv'lv a;ul iluj resuli> ot" thai acMviiyarc po--sjbic. The -^alue 
IS oh\ious. Ihc prnt!rarn\ v>p'jfaiions can be rnorah)fed and 
e*. sdualed oJi ihc b;i-.r- oi" •.shicli p»>sihve change js produced in 
the cniployahility of the chentN the overall i;o:il a itain- 
lue program C hanue or lack of change sug>a's[s revisions rn 
progratn nii\ and vioscr e\aniination i>f a particiilar aeliv- 
\l\ or service. By c* 'rcialtng changes m clicnl^' employ- 
abililv '\tcli>rs u> ciicni success or failure in achrcving 
desir,:iile cmploymcnr-, ihc program operator can dclcnninc 
d' iherc js anv prcdicli-.e value lo ihc various emplnyabiiity 
t actors. 

liscamhia Counly has luvdeMakcn a plan to make ils inter- 
vening chcnt assessmcnis rriore reliable by providing special 
training lo caseload managers, who iirc in touch wiih ihc 
clicril on a reguVar basis in many insianccs. change can he 
raied on ihe basis ;?f a ciienl's achievcmenl of parlicular oh- 
icctivcs in the prvtgram. I'or jns;ance. if a client is assessed 
a'v havsng no vocational skills, he or she uiil be given a tV.c. 
the louesl ratm.a on lhal empicy:ibi!it\ faclor. if the irainmg 
provides the chenl vMih enrploymenl skdls. the inslrucior con^ 
dueling (he skills irammg rates the client. The CtJseload man- 
ager then only rrtrcds to so]^ : this informaiion, not produce 
i{. Frequcnliv, the same is true of academic assessment of 
clients enrolled m remedial education class, who are rated by 
ihcir iristrucior to determine the grade icvel change ^lurinj! 
their enrollment. 

Less easy to measure are behaviorid chiinges. In this m- 
stanee. the assessments arc subjective, and there can be. a 
•Ajdc variance bet^^cen the initial subjective judgment of the 
assessor and any subsequenl judgmxnls made by program^ 
slufT at o^her points in \hc intervention process. The risk is 
lhal observed changes roay merely rcHect the observers* 
biases rather than any actual change. 



Artother function served b> the cticrri .»'.iscssment ccnie? js 
ihar<)l" uiformauoft and refer: ai Man\ clients assessed have 
needs -i'^at canr.^i he mcl by a ( OA sraininu pf^.^gram In 
sonic itwUt^cc'v '.hcse clierifs v.nijld n M he <ippropriatc «'c- 
Icrta!^ I'^r t: (n Ihe hrst t;t iip^jr ;i\ion. ih^: a^^c^S' 

:;u*r.! vV iSc:'^ ^iMv^Uk ^ showed that '>f ^jH Use cttcntn 

,;s^\:s^cvi -Acrc fcJerrcd :u a .inc? rccejvevt 

ir.jiruni: T hese cUc:ms h^l an uru^Mi.ill;.' io^^ <U^->p^.^\A taiw ? 
pe[ce:>\) and a hr^-h nSaCcmcnt r,i- c o percenu Ano'hcf 
ihird v\erc lound to >un'er S'jct< ^c-ere pi:-, srcal -vxiiiAl 
i^ip.!;r;nl:nt^ lhal thcv ^=»cre ebgiblc h^r v^>caiiOnal fchabdaa* 
iivin scrMCe^ In ihcsc cases. v^^cati-inal rcbatulilaljon 
voun:>clor uho oarucipatcd in \\\-: jssc^srrcn^ 'nade ^rppro- " 
male referrals for iha! clicn' 

Approx jMiaJel) a third or the ciict.'.^ as^c-^.-c*! '-cf'e n^tl el- 
igible voc«i»'('^ifud rehab;l;talion . rn^r were 'hcv apprup- 
rtatc referral for uasnmg avadabie under CPTA Mernbefs 
of -I !s group, termed *\gray-area chcnis." v^cre generally 
found to be fu nclionmg ai a io',v academic level (third- to 
foufih'grade). During the asse^iSmcnt process. the> e^hibaed 
behavior that would not be conducive lo successful irainiiTg 
(acting out ovcri hostility, hemg disruptive in a group, or 
sho'Ainr no apparent motivation for training or interest in 
programs available under CBTA ). The gray-area client group, 
also included program ''hoppi:rs/' alcoholics, and drug users. 
This has led the CHTA prime sponsor lo plan have special 
programs to accommodate some members of the group in 
fiscal i978, The assessment center also has ic(entir;ed specif' 
ically the characteristics of those peo'pic 'Abo were '"falling 
between agencies '* In conjunction ^^ith other agencies, some 
clun?'^s beir^g mvide lo pro'^t^k special programs ihiU ^viU 
help these indjvsduais lake advantage of the educational 
v>pportun-Uies provided through C!:T.'\ or the cummunUy 
schopi sys'.em 

Thr expense o' an operation ibat provid^'s stich compleie 
services :s>":ohih!iive unless the cost as shared by a number 
of agencies in ad Jilion to the CHTA pr^mc sponsor. Such ;$ 
the caoc in Ejicambia Counly, where the local-health dcpafl- 
nicnt. the vocational rchabililaiion service, the social welfare 
olhcc. and other agencies rcc gnize the need to join their re- 
sources w ith thcCETA program to serve essentially the same 
population segment. Many of the stntT and resources required 
m an assessment center are provided by thc^e agencies. This 
reduces the cost of this operation to $68.(XK) a year to the 
CHTA prime sponsor. The relationships of dhc contributing 
agencies and their respective responsihiljiies are clarified in 
'A ritten agreements. 
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4. ^rvlMARY AND -CONC'LUSI-ONS ■ 



tncy c»jn determine ihc (unciu^m inunx and! aiscst^issctu 
v«,|i| scf^N" O^^^i^^ the juncUon> h.wc bct^n dc«crmincii. Uic oev. 
step is to sctccl fnosc tnsuuracn^s \^.vo pru4:irdutc> ih.j! pro- 
vide- the }nfornKiith>n lo suppari (hc>cnccd^- nKhnUn^r inUn- 
mation on ?;haih}ht> ,jr:d pfii^hiv for sclcchofi^ Unless ihc 
prime >pon.sor is ];Mhc !t>rti;njU' circusnnumce of hcsnf* able 
u> serve ii'C ;ippivfng. ^'>mc >y>!c:rc !or a(l<iihnr?,i? 

^crcc^t^j* is jvvcc-^.ifV. the c+.'crU th.it thc-lM.i >'Jrj 

a more Cijuna^Jc v^GC" 



The Selection System 

Bcv\arc of mfurnial sclccut^n sys^cn5^ "l irii c-;>nii:, Tjts? 
'served" t> ihc most p/>pular sysi<:nb oper-iUion today. The 
onJy giiud thai cm be suit! ahinu ^.Ijjs mformjii sclccUon 
sysleni is that \i docs not operate with any ticljbc?a5c bias. An 
■ jnTormiil mc;tns of making Juds; men on cHcni Selection K 
hard to defend. Any prime >poris6r ihai cannaJ accomfrtodasc 
every eligible applicant-jn its*jufi>^jicnor;;.iS issin^ a ^etecuon 
system of some kmtf. fornuj! or infofm;s) The advanSagcs of 
a formar sele^jtion sysiem arc that it utTcfs some opporiuniiy 
for conirol. can be moniiorcti and cvaluaied Tor i!s ciTecir>c- 
c^^>. can br, sludizfH for poislhlc ch(inp.cs. and boih !he system 
and judgmenrs afisin,? from \i .itc thus ca^ic^i to defend. 
Hvcry prime »ipo«*u.^;. regardless >5^?:e. should eMahliNh 
/ some formal sithrcuon sy item .There is no oifitr dc;Htndahlc 
\vay of scfe^ung frahi among the elip.'Me .^pplicafUs ^futs'^. 
eiienU who carvhe ^c^v<id etlcclivclv ^ 



lie Services Svsfem 



Gencrflh. r^r^/nc spnnv:n's .jce *^:uKvare whet's- \his\ arc 
jiii,ssin^- • .-.VjC in:uk u\ ptij\\d'ini\ appfupr?aic ^crvke5. to" ihc 
cl]cn\ A pfifiu: ^^^mvoT^^iU ?fy Wi provide ihc staodard serv- 
•ce>. -lab a> day ^.uc. counnclm^*, general educaUon^, ..«Rd 
s.k.jUs u'ctifiinij,. Clii;n^s take adv-aruagc of these services simpl>\ 
because Uicy .iu: ;:v.;^iibb!c lo \hcm. Prime spi?nsors 5 hep con* 
^;iude Ot^it Jhcsr plan^or %crvicc:> !!s a eoi)d one, ^ 

i-L-h'. uf?t'>".v r-r»;n»rafu5 %-;:rva"c*- are iScictrntncd by ;? pfofe* 

k;^MiiriMc ?>;;Liift dsivcfopang ^if' pro|?ranr Hi?vvcvcr, ic^ 

^-n-t.'ne ^>niM:-.v'=j ai:qu5fc^ c:^pc?jence >*-j5h CMi:rii5. Icvd 2 or 

uiirdsfji.";! h?![St5> rrh>re sr>. iiric '.^^U: the fcaiUicii. of U?e 



The Assessment SYstem 



• A levc^ J a:^>c:vsmenJ 5.e;*c<^ns for eiigihrUty and'pr«orhy for 
scf. icc. A Jeve! 2 a^^oi^fmcnj is a mirikna? rcqukcm^jpl for a 
•^ood iruakc and assessmem acihi^y Levcil 5 .ii^?»es5m€nls; 
makc-'posstble indu {dMaH<'ed pt:?rr> for servkcs bv. providing:^ 
jm>?c client data in grc-i^cr dctiiiL Ursfortuniitely, many 
ri^lW.r:s iVeMs arc either fnivinserprcicd or overlooked bcciusc 
of jnudcquaic a^se^^smeni v^^tcms Thos^ piime 3»ponHors 
b^j^vsed wish acuJcly ticnsiiijvc and oh^ervaot fviai^T. ^vho en- 
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Ti:c msirunicnis jv.iihihic for asscs>mcni have many shon- 
Ci>n nizs Tr -j i>ldcr lcst.'^ do noi l\{ the special charuclerjstics 
oi the drNjd\ aniaficd population served by CETA programs. 
The newer instrumeni^ desitjnc(i lo serve disadvantaged per- 
>t>nv e nr-' •.-.•en in e violence long cntDuch to be -validated 
a high iexel of contidence. Program director are per- 
plexed in their >earch for a valid :tnd- reliable assessment 
ifKirument. 

The success of anv. program activity depends upon' the 
ci>mpetenc> oi' the people dealing on a one-to-one basis with 
- the client. There is no substitute for know-how on the part of 
the stair th:*' ruiuvt-- as-e>sfnent. Any assessment instru- 
meiu. be i[ i iiervievv or the MM Pi. will not compensate 
for st.itT li:7ii!atio-ns. Assessment instruments should be con- 
sidered as a w;;v to aid competent stalT to make objective 
"mdgmenis when confronted '.wth extremely subjective cri- 
teria. Thev organize one's thinking and approach toward the 
gathering ot information. One should not hesitate to use an 
Instrument simply because i! has not been proved beyond a 
dbubi to be valid, but should exercise caution when using 
test result.s. There are no infallible instruments. Some are 
more nearly valid than others, and this, along with costs, re- 
usability, and sophistication of the assessor, should be the 
g u id e t o I h ei r select ion. 

The selection of assessment instriiments is based largely 
upon what purpose assessment uill serve. It is assumed that 
avsessment wil! always be used to determine client eligibility. 
If this is its onlv functio.i. a prime sponsor probably would 
not be interested in any testing instruments that have been 
described here. On the other hand, if the function of the as- 
sessment center is to provide an information and referral 
service, the program director .should include a structured in- 
terview, biographical information, and a physical examina- 
tion or basic ph\siologicaI screening so that a referral to 
medical resources. will be possible. If the assessment center 
is serving as a means of outreach and recruitment for the use 
of a cummuniiy health center, perhaps it would include 
psychological screening, 

Once the functions have been agreed upon and the ap- 
propriate assessment devices selected to provide the informa- 
tion that will accommodate tht)se functions, the program 
director must decide hovV to manage intake and assessment. 
Much can be said for the interagency approach. It is cost- 
efreclive and opens the door to other agency resources for a 
client .When each CHTA client has had contact with another 
agency's stalT. a rapport is usually-established that facilitates 
the client's receipt of services from that agency. 

In many cases, prime sponsors are concerned about main- 
taining the iniegrits of their programs and separating their 
programs from the political arena. Some thought should be 
given to h;iving an agency outside the prime sponsor's direct 
control provide the certification of eligibility for CETA 



ciienls. The local State employment service is readily avail- 
able and meets this criterion. As an agency neither budgeted 
by nor under the control of a local government otficiaL the 
employment office, throu^rh a financial or nonfinancial agree- 
ment, is ideally suited to take applications of clients, to judge 
whether they meet the specified eligibility criteria, and to 
complete the certification process. 

The State employment office, because it has considerable 
contact with unemployed people, cculd also provide either a 
level 2 or a level 3 assessment. It has a role to play in most 
intake and assessment processes. 

In some communities, the local health or welfare agency 
has stalT who could do sophisticated testing. Such an ager, y 
may contribute its sta(T to a joint intake, assessment, and re- 
ferral elTort with the CETA pre am. 

Another agency that has the sj.paq goals and renders care 
to many disadvantaged people is the vocational rehabilitation 
service. This agency normally provides diagnostic evalua- 
tions to determine eligibility for its services. It can often pro- 
vide the' same service to all CETA clients, in exchange for 
?iharingjhe cost of assessment. 

Local welfare departments and WIN projects may be in- 
terested in assisting efforts to bring service to the welfare 
client or potential welfare recipient 

Arrangements among agencies to provide assessment scr\ - 
ices involve careful planning. Controls over the activities 
should be carefully defined and delegated to particular 
individuals. 

Although working in conjunction with other agencies is 
cumbersom.e and can be frustrating and aggravating for a 
prime sponsor, the rewards to the client anci the community 
make this effort worth careful consideration. If interagency 
cooperation is a problem in one's community, perhaps this is 
the time to take the first step toward facilitating an inter- 
agency etToi't. A prime sponsor might be able to offer an as- 
sessment center just as inexpensively — and more conven- 
iently—on its own. Yet in the hope of making closerxoopera- 
tion among agencies the scenario for the future, it might still 
want to take the lead in planning an interagency center. 

A key element of an intake and assessment activity is its 
logistics, as demonstrated by the Broward Manpower Coun- 
cil, which uses mobile units to provide services to remote 
areas, h is unlikely that a level 3 assessment center, especially 
when it includes a work evaluation 'laboratory, can be rep- 
licated throughout a large area. It would be necessary to 
transport the clients to an as.sessment center, or to set up a 
mobile assessment unit. The latter is expensive and would not 
work as welL because testing requires private offices, and a 
work evaluation laboratory must have considerable space for 
equipment. More limited mobile units or multiple intake cen- 
ters can be established throughout the prime sponsor's juris- 
diction; then, with the help of some prescreening. certain 
clients can be selected for extensive assessment and referred 
to a central location. 
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Screening Clients 

One of the problems that level 3 assessment encounters is 
screening certain clients to take certain tests. One approach 
is to have a battery-of tests that all clients must take. The 
same history and data are thus available for every client, 
v'.hich ia invaluable for program evaluation or research 
purposes. 

Another approach is the "filter'' system. Eligible clients 
are given an intensive orientation and structured interviews, 
with screening according to individual needs and expressed 
wishes for services. These are matched with services avail- 
able in the community, and referrals are made. 

Screening for agency eligibility criteria permits a large 
group of CHTA eligibles to be referred for services. Those 
who are not diverted by the process are **filiered'' through to 
CETA. .Although this process does not assure thai every el- 
igible applicant will receive services, it does reduce the num- 
ber not receiving any services. More importantly, it identifies 
those clients whose needs are not being^met by the commun- 
ity. CETA sponsors have the option of developing new pro- 
grams that can better assist the client or approaching a con- 
sortium of agencies and asking them to pool their resources 
to meet the identified needs. Communities that have under- 
taken such efforts find that it is the first time that clients have 
been identified and described as to characteristics and 
needs the first step toward developing programs. 



Summary 

An assessment activity may lean toward either of two pos- 
sible extremes. One is the "medicar^ model, which assumes 



that a client is there because something is out of order. The 
process of diagnosis, prescription, and treatment is controlled 
by agency staff who regard the success of the therapy as a re- 
flection of their skills and expertise. The **humanistic" model 
assumes that, so long as everyone, particularly the staff, is 
feeling good about whatever is going on, results are bound to 
be good. Somewhere in between is an approach thai accepts 
the client as a mature human being, capable, with informa- 
tion and counsel, of charting his or her own path to a success- 
ful career future. Although there are no laws of human 
behavior as there are laws of physics, there is a depth of 
understanding about the causes af behavior and learning that 
suggests commonalities among people in general. These 
commonalities become the attributes measured by various 
assessment techniques. 

The state of the art of assessment in employment and 
training programs is generally crude and unproved. Those 
prime sponsors that have instituted assessment are unvvilling 
to give it up, but they can produce little documentation that 
it has had any positive effect on programs or clients. The 
need for research is obvious. 

Equally credentialed experts argue for and against testing. 
A prime sponsor may as likely be condemned for testing 
clients as for not testing. This monograph does not suggest 
any course or.action regarding testing, but it does argue for a 
formal assessment (as opposed to an informal assessment), 
outlines progijm issues and marjagement concerns that af- 
fect assessment, and references other literature for further 
research. A prime sponsor wanting to know whether its in- 
take and assessment component is having a positive effect on 
employment and training program outcomes will have to rely 
on its in-house program evaluation capabilities for confirma- 
tion. It will be through research undertaken by prime spon-'' 
sors in the *Maboratories" of their programs that the state- 
of-the-art of client assessment will grow. 
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APPENDIXES 

A. Report by New York State to the Department of Labor's 
Manpower Planning Secretariat: 

A CETA Participant Selection System for Titles I arid 11 , 



Using the System 

This selection system, specifically designed for New York 
State prime sponsors, is intended to serve as a managernent 
tool. By using this system, a coordinator will have/an addi- 
tional tool for the selection of CETA participants. A score, 
obtained from a matrix, provides for the selection of individ- 
uals based oa need.* Therefore', persons with the highest 
points — the most needy— are then selected for a particular 
program. 

Conversely, when funding for a program is. halted*, the 
matrix may be used as a layoff system. Particiiiarus with the 
lowest point totals are basically the ones who arbsje ast in^ 
need; therefore, they should be the first ones to be laid off. 

By choosing this system, program coordinators are able to 
conduct an assessment of their participants by making a 
check of the par . xipant's score over a period of time because 
/ a higher score indicates a more needy person. For instance, if 
at the end of a training periodva participant has a higher 
score than when he or she enterea\i^nto training, the employ- 
ment has not been beneficial or the 'participant needs more 
training. 

C 

Method. The usefulness of this system is partially reflected 
in the ease with which it is set up. The vertical categories (see 
matrices at end of next section) are labeled as economic char- 
acteristics and do not change from prime sponsor to prime 



sponsor. Horizontal components are social characteristics 
and reflect significant segments within the prime sponsor or 
balance-of-State area. 

Beginning at the right-hand side, number the social char- 
act^ri^iks commencing with one (I) and proceed in integ^s. 
This is done so that the category^hat has the highest number 
receives the highest priority. \Economic characteristics are 
numbered from bottom to top\ starting with !.0 and pro- 
ceeding in two-tenth intervals. The rank for a category is , 
arrived at by cross-muh iplication. 

A final score is obtained by adding the points for each spe- 
cific social characteristic on one horizontal line. For example, 
if a CETA^rticipant is eligible for a Title I position and is 
a food stamp recipient, the interviewer would use the second 
horizontal line. Assume also that the individual is the head of 
a household, 27 years of age, and a female; the total score is 
then 22 — 1 1 for head of household, eight for being in the 25 
to 44 age group and thre^ for female. 

Rules. Paragraph 95.31(c) of the CETA Rules and Regula- 
tios (May 23, 1975) provides for the use of a system that 
Establishes priorities: 

1. A person may take credit for only one'economic charac- 
teristic; i.e., whichever yields the highest rank. 

2. A, person must claim at least one social characteristic, but 
should claim more than one where qualified. 



3. A person may claim only one kind of veteran status: i.e., 
-whichever yields the highest rank. ^ 

4. The economic characteristic defines v^hich horizontal line 
to use. 

5. The '*other'' category is also included to give an inter- 
viewer some managerial control over the selection process. 

6. Only one **family member'' should ordinarily be included 
in a county's CETA program. 

7. Participants must be in^farmcd that job opportunities are 
transitional and will not ordinarily exceed |8 months. 

Categories. The economic characteristics determining 
eligibility of potential participants for each of the titles are 
defined in the CETA Rules and Regulations. They do. not 
vary from county to county or from prime sponsor to prime 
sponsor. They are targeted to the population that the specific 
title was designed to serve. 

A significant segment, defined in paragraph 94.4 (yy) of the 
Rules and Regulations, is a group of people to be charac- 
terized, if appropriate, by sex, age, and racial or ethnic origin 
and by occupational or veteran status which causes them to 
generally experience. unusual difficulty in obtaining employ- 
ment aiid who are in need of the services provided by the title; 
i.e., a significant segment need not be the same in all titles. 
Other descriptive categories may be used to define a sig- 
nificant segment, if appropriate. 

Data on significant segments may be obtained from several 
sources, including the following: , 

1. 1970 census of population. 

2. Unemployment insurance beneficiary data. ^ 

3. Employment security automated reporting system 
(ESARS). 

4. The universe of need. ^ 

.5. State-aided programs— public assistance en rollees. 

6. Economic profiles— New York State Department of. La- 
bor, Manpower Planning Secretarial. 

7. Labor force data. 

One of the basic responsibilities of prime sponsors in ac- 
cordance with paragraph 95.3 1 of the Rules arid Regulations 
is to establish priorities for receipt of assistance authorized 
under the act, taking into account the priorities identified by 
the Secretary and the significant segments represented among 
the economically disadvantaged, unemployed, and underem- 
ployed residing within its jurisdiction. 



Title! 

Economic Groups To Be Served 

\. Home relief recipients. By serving those most needy in-' 
dividuals first, the prime sponsor is relieving the enormous 
welfare burden currently in place in all states. 



2. Economically disadvantaged. As defined in paragraph 94.4 
(t), (1), (2) a person is poor if he or she is a member of a 
family (adapted in accordance with paragraph 95.32 of the 
Rules and Regulations): 

a. Who receives cash wi!l fare payments or 

b. Whose annual income, in relation to family size, does 
not exceed the Office of Management and Budget pov- 
erty level. 

Z.. Unemployed. As defined in paragraph 94.4(ggg), (I), (2). 
a person who is without a job and who wants and is avail- 
able for work, defined as **a person who did not work dur- 
ing the calendar week in wh»ch the determination of his or 
her eligibility for participation is made."" 

4. Underemployed. As defined in paragraph 94.4(ff0, ( 1 ), (2). 
a person who is working part time (less than 35 hours per 
week) but seeking full-time work, or a person who is work- 
ing full-time work but whose salary relative to family size 
is below the poverty level. 

Special Consideration. Adapttd in accordance with para- 
graph 95.32(e), (I), special consideration shall be given to vet- 
erans in two categories: 

1. Disabled veteran (defined in paragraph 94.4(2], [3f) is a 
person who serve^d in the armed forces and who was dis- 
charged or relea^d therefrom with other than-a dishon- 
erable discharge and who has been given a disability rating 
of 30 percent or more. 

2. Special veteran (defined in paragraph 94.4[zz]) is an in- 
dividual who served in the armed forces in Indochina or 
Korea between August 5, 1964 and May 7, 1975, and who 
received other than a dishonorable discharge. 

Social Characteristics 

1. Head of household. Defined as a person who is eligible to 
claim more than himself or hqrself on income tax forms. 

2. Dro/7owr>0efined as an individual who is at least 25 years 
old and has not attained 12 years of education. 



Title n 

Eligible Areas. An area of substantial un\;mployment (de- 
fined in paragraph 94..4[d],(l], [i],[ii]) shall mean any area 
which: 

1. Has a population of at least 10,000 persons. 

2. Qualifies for a minimum allocation of $25,0(X) under Title 
II of the act. 

3. Has a rate of unemployment of at least 6.5 percent for a 
period of 3 consecutive months. 
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Ecomonic Groups To be Scned. Adapted in accordance 
with paragraph 99, 36(b): 

1. Unemployed persons who have exhausted iheir unempioy- 
menl insurance benefits. 

2. Unemployed persons who are not eligible for unemploy- 
ment insurance benefttfi. 

3. Persons whd-are unemployed for 15 or more weeks. 

4. Persons who are unemployed for at least 30 days but not 
more than 15 weeks, 

Special Consideration. Ijl liccordance with paragraph 
99.37i;a),(b),(c) special consideration shall be given to: 

1 . The economicaliy disadvantaged: 

a. Home relief. 

b. Other economically disadvantaged, such as food stamp 
recipients or those who have a family income below the 
poverty level, 

2. Veterans . 

a. Disabled. 

b. Special. 

3. Former trainees. 



Conclusion 

It is important to note that the matrix can and should be 
tailored to individual counties. .jEach county has its ow n prior- 
ities and significant segments. The county manpower coor- 
dinator must decide whom to serve; once ibis decision is 
made, the seif-sustair ^ng matrix will accomplish this end. 

The matrix converts client characterillics into a numerical 
code that can be combined into an overall rating of eligibility 
of each client. This instrument addresses one of the frequently, 
cited problems among prime sponsors. In view .of the eligi- 
bility requirements as spedifi^cl by the Ruies and Regulations 
under CETA and the priority classifications identified by the 
coordinator, how does one decide whom to enroll when there 
arc a number of people meeting criteria for eligibility and 
representing different target groups? This matrix addresses 
the problem by quantifying these characteristics so that they 
caii be combined into a total score. 

Finally, it must be stressed that, while the matrix is not the 
final answer in a participant selection system, it is an im- 
portant tool that can aid employment and training planners 
in most effectively serving their respective populations. 



CETA Title I— Intake Preference Matrix 
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CETA Titles II and VI Intake Preference Matrix 

Social Characteristics With Assigned Weight 
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" 7 


6 


4 


3 


I 




UncmpToyed 






















1.2 


1 5 or 
more 
weeks 


12 


1 1 


iO 


8 ■ 


7 


6 


5 


4 


2 


1 




Unemployed 






















1.0 


less 
than 
\ 5 weeks 


10 


9 


8 


7 


6 


5 
• 


4 


3 


2 '. 


I 


For cxplunution. «icc footnote uccumpjnvmp CETA TkIc I Mjtrix, iihovc. 


* 
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B. Goodwill Industries of South Florida, Inc., 
Re-Education Program 

Behavioral Assessment Procedures 



Source 

The following items are from the Burk's Behavior Rating 
Scales adapted to the workshop situation in order to pVompt . 
' specific data during the work evaluation . 



Procedure 

Enter in the "recommendation for the behavioral prescrip- 
tion" only those items on the "behavioral assessment check- 
list" rated one (1) or two<2) on the rating guide of the "work 
evaluation report"; i.e., ^'completely inadequate or below 
average vocationally." . 

1. Behaviors and performances receiving a rating of one (1) 
are acceptable only in a highly structured, supportive, non- 
competitive work setting such as a sheltered workshop. 

2. Behaviory and perforrtiances receiving a rating of two (2) 
suggest that the participant is achieving belo^y the level of 
competitive employment. However, there are indications 
that with additional treatment and/or training, he may be 
able to function with such a work setting. 

Behavioral Assessment Checklist 

A. Personal appearance . 

1. Grooming 
' 2. Work attire 



B. , Physical assets and liabilities 

1 . Poor physical strength 

a. Avoids physical effort. 
^ b. Gets hurt in physical work. 

c. Gets tired quickly. 

d. Will not do rough work. 

e. Appears physically lethargic. 

f. Slow. 

2. Poor coordination . 

a. Has trouble holding onto things. ; 

b. Shows poor coordination in large muscle activity. 

c. Handwriting is poor. . 

d. Accidentally runs into people and objects. 

e. Drawings and paintings are messy. 

3. Obesity , 

C. Mental abilities - 

1. Poor academics 

a. Shows poor reading. 

b. Shows poor spelling. 

c. Follows academic directions poorly. 

d. Assignments are poorly written. 

2. Poor intellectuality 

a. Does not ask questions. 

b. Perseverates^, cannot shift responses. 

c. Gives inappropriate responses. 

d. Does not show imagination. 

e. Has trouble remembering things. 

f. Shows poor vocabulary. 

g. Does not show common sense. 



31 



3. Poor attention 

a. Show^ erratic, flighty, or scattered behavior. 

b. Is easily distracted, lacks continuity of eiTort and 
perseverance. 

c. Attention span not increased by punishment or 
reward - . • ^ ^ 

d. Attention span is short. 

e. Cannot fmish what he is doing: jumps to something E 
else. 

4. Poor reality contact 

a. Tells bizarre stories. 

b. Uses unintelligible language. 

c. Shows daydreaming. 

' d. Shows tics and grimaces without apparent reason. 

f. Rotates or rocks his body. \ 

g. Makes weird drawings. 

h. Is unaware of what is going on around him. 

D. Emotional stabilily 
' . Excessive anxiety 

a. S-hows many fc^rs. - * 

b. Appears tense. 

c. Worries too much. 

d. Flushes easily. 

e. Appears niervous. ^ 
,;2. Poor impulse control 

a. Becomes overexcited easily. 

b. Is hyperactive and restless. ^ 

c. Shows explosive and unpredictable behavior. 

d. Is impulsjve. 

c. Cannot control self (will speak out orjump out of 
seat). 

3. Poor anger control 

a. Becomes angry quickly. 

b. Becomes angry iPasked to do something. 

, c. Is quickly frustrated and loses emotional control. 

d. Explodes under stress. 

e. Flares up if teased or pushed. 

4. Excessive self-blame; 

a. Questions indicate a worry about the future. 

b. Upset if ma'*es a mistake. 

c. Shows overremorse for doing wrong. 

d. Is upset if things do not turn out perfect. 

e. Blames himself if things go wrong. 
5- Excessive resistance 

a. Is stubborn and uncooperative. > 

b. Is rebellious if disciplined-. 

c Denies responsibility for own actions. F. 

d. Does things his own way. 

e. Will not take suggestions from others. 
6, Excessive dependency 

a. Is dependent on others to lead him around. 

b. Is overobedient. 

c. Is easily led. 

d. Wants Gthers to do things for him. 

e. Seeks constant praise. . 



7. Excessive sense of persecution 

a. Maintains others pick on him. 

b. Complains he never gets his fair share of things. 

c. Will not forgive others. 

d. Accuses others of things they actually did not do. 

e. Complains others do not like him. 

Interpersonal Relationships 

1. Poor sense of identity 

a. Acts as nonconformist. 

b. Wears unusual clothing styles. 

c. Associates with loners. . 

d. Rejects classmates in hostile manner. 

e. '"Style" of behaving deliberately different from 
most. 

2. Excessive withdrawal 

a. Is difficult to get to know. 

b. Shows little feeling when others are upset. 

c. Withdraws quickly from group activities; prefers to 
work by self. 

d. Is shy. . 
c. Do'es not show feelings. 

f. Appears disinterested in work of others. 

3. Poor social conformity 

a'. Displays a ""don't care" attitude; does what he 
wants. 
^ b. Tells falsehoods. 

c. Does not follow through on a promise. 

d. Takes things which do not belong to him. 

e. Shows little respect for authority, 
f/ Is tardy. 

g. Is involved in undesirable escapades. 

' h. Is truant. — 

4. Excessive aggressiveness 

a. Laughs when others are in trouble. ' 

b. ' Hits or pushes others. 

c. Wants to boss others. 

d. Is sarcastic. 

e. Teases others. 

f. Plays tricks on other children. 

5. Excessive sexuality 

a. Employs much sex talk. 

b. Reads questionable sexual material. 

c. Acts boy. crazy or girl crazy. 

d. Wears sexually provocative clothing. 

■ e. Studies pictures of pornographic nalur^. 
f. Shows exclusive interest in opposite sex. 

Work habits 

1. Poor ego strength ] 

a. Depreciates andili>trusts own abilities, 

b. Is easily satisfied with inferior performance. 

c. Avoids competitio'h.. 

d. Is easily frustrated and gives up passively. 
. e. Acts silly. ' 

f. Shows little self-confidence. : ■ 

^. g. Plays the clown. ' . • 
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2. Excessive suffering 

a. Sulks. 

b. Appears unhappy. 

c. Seems to welcome punishment. 

d. Deliberately puts himself in position of being 
criticized. 

c. Gives picture of "poor me.'' 

f. Feefings easily hurt. 

g. Appears depressed. 



II. Ratings and Beha\ rs in Job Sampling 

A. Learnin,'. and r^mprehension 
, 1 . Responses to instruction 

a. Requires minimal instruction for task completion. 

b. Requires moderate instruction and. completes task. 

c. Requires extensive instruction for task completion. 

d. Does not complete'task with extensive instruction. 

2. *'On-task'' behavior 

a. Rarely on task. 

b. Fluctuates from on task to ofT task. 

c. More on task than off task. 

d. Stays on task. 

3. Flexibility - rotation of tasks 
a. Adjusts well to new tasks. 

v b. Adjustsao new tasks with minor difficulties. 

c. Adjusts to new tasks with major difficulties. 

d. . Cannot adjust to new tasks. 

B. Performance characteristics 

Frustration and tolerance 

a. Attends to job regardless of obstacles. 

b. Attends to job with evident frustration. 

c. Has difficu^i^ttendingtojpb when confronted with 
obstacles 

d. Cannot complete job when confronted with 
obstacles. . 

2. Consistency of effort 

a. Shows consistent work behavior. 

b. Shows moderately consistent work behavior. 

c. Work behavior was erratic. 

d. Work behavior was unstable. 

C. Work attitudes 
1. Adaptation 

a. Upon being familiarized with shop rules, the client 
adjusts with little delay. 



b. Upon being familiarized with shop rules, the client 
adjusts with some delay. 

c. Client has difficulty adjusting to shop rules after 
being familiarized. 

d. Client cannot adjust to shop rules though familiar 
with same. 

2. ' Motivation toward work 

a. Demonstrates initiative in finding tasks to perform. 

b. Client will frequently seek tasks to perform. 

c. Client rarely seeks tasks to perform. 

d. Client is'content to sit idle. 

3. Stress responses 

a. Works best under little or no stress. 

b. Work responses improved by occasional stress. 

c. Work responses best under constant moderate 
stress. 

d. Work responses best under constant strong stress. 

4. Punctuality . ' 

a. Institutes work behavior imrrfediately. 

b. Seldom delays institution of work behaviors. 

c. Frequently late in instituting work behaviors. 

d. Consistently late in instituting work behaviors. 

5. On-task work behaviors ' * 

a. Stays on task while' working. 

b. Stays on task more than off task while working. 

c. Stays on task one-hiilf of the time. 

d. Stays off task most of the time. 

D. Interpersonal relations 

1. Reaction to supervision , 

a. Works best with little or no supervision.. . 

b. Works best with limited, supportive supervision. • 

c. Works best with firm supervision. ^. 

d. Cannot work without supervision. 

2. Peer relations 

. a. Achieves group acceptance quickly and easily. 

b. Achieves group acceptance after a short period of 
time. 

c. Achieves group acceptance to a limited degree. 

d. Does not achieve group acceptance. 

E. Appearance 

I . Grooming 

a. Consistently neat and clean. 

b. Needs periodic reminders about dress and/or per- 
sonal care. ^. 

c. Careless about personal cleanliness to the point of 
giving offense. 

d. Consistently unkempt and disordered— makes little 
or no effort to meet standards of typical group. 



GooDwtLL Industries of South Florida, Inc. Re-Education Program 
Form For Recording and Controlling Behaviors 

' Program ^ Name 

\ 

Workstation Dales 



Mon. Tucs. NVcd, Thurs. Fri. 



. 1 L 
P 












Defining behavioral goals 






- 






2 L 
P 






















3 L 
P 






















4 L 
P 






















Total 
of 
P 













P • CuunlufuciuulbchuvlororpicctA. 

L • LimH<olim;jic)urinupprupriuic behavior or mcixs >»hich determine re>*jrd or noi. 
V . Regard granted. 
X ■ RcMatd denied. 

l-2-,M - Ouaflerof Ihe Horkina djv iihvided hv .1 m ^I'c.'^. tijnvh. jrd r rri ^rcjk! 



34 





C. Summary of Assessment Tools for the Disadvantaged 



Assessment 
tool 


Furpose 
for which 

it was 
constructed 


1 

Other 
planned 
purposes 


Time 
needed to 
admimster 


Required 
skill level 
of tester 


Expense 
of admin- 
istration 


Group 
or 

individual 


Validity, 
reliability, 
norma ti 
data 
available ' 


Population 
of intended 
use 


Format 


Basic Occupa- 
tional Literacy 
Test 


Counseling and 
personal devel- 
opment 


Asiignmcnt to 
training 




Medium 


Minimal 


Group 


V/R/N 


Disadvantaged 
adults 


Measures arith- 
metic and 
reading skills. 


Biographical 
Information 
Blank 


Job placement 


Counseling and 
personal devel- 
opment. 
Assignment to 
training 


No time 
limit 


Minimal 




Both 




Disadvantaged 
manpower 
program cn- 
roliccs 


Application 
blank style; 
simple, fourth 
grade reading 
level fonnat. 


Colorado Man- 
powcr.Labora- 
tory Instru- 
ments 




















a. Social 
Access 

' Question- 
naire 


Research 


Admission to 
program 


30 min. 


Medium 








Disadvantaged 
manpower pro- 
gram appli- 
cants and 
crroll5t2S 


Eighty-nine itct:* 
questionnaire 
measuring six 
personality fac- 
tors and per- 
sonal-history. 
Multiple 
choice and bi< 
polar agrcC' 
disjigree items. 


b. Revised 
Mtskimins 
Self-Goals 
Other Test 


1 , - 
















Complex chart 
and rsting sys- 
tem asking 
client toiise 
three different 
perspectives in 
filling out the 
chert three , 
limes. 



• V . validity dsU nvailabte 
. R ■ rtliibihty dauxvaiUbIc * 

N - normative dsta available. * 
No cfitiy mains thai no dill ■ wtre avditiible dt ihc time thi» chaii wtf I prepared. 

SotM'fe: Backer . Thomai E.. Ufih&d^ of /iitrtsins the Oitadvaniont^ in H4anpowrr Prvjtrams: A ftn-inntand AnaiitisALoiAnttiti: Human Inttrtctton j(«s<arch Ifiwh 
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.-is* turner. I 
:oc! 



c. Work Rc- 
quircTne:ni2 

Scale 



d. Importance 
Question- 
naire 



for H /i/f A 

it it-aj 
consimcied 



^essarch 



i 



c. Employ- 
fiicni Ssiiv 
faclion 
Question- 
naire 



f. JobCofldi- 
lionsQucs- 
liorinaire 



g. Job Expec- 
tancy 
Rating 

h. Job impor- 
tance Pre- 
diction 
Scale 



i. 'S<!f-Acccp- 
lance Ques- 
tionnaire 



J. Similari'jt*; J 
Scale 



purposes 



} \rr\c 



Admission \o 
proftram or 
job pisccmcr.i 



rrogram zmvj- 
a tier: 



Counsehng or 
job p!accr."icnt 



skiH Igvel 
oftrsur 



Group or [ rdichiliiy. 
or \ nOrr^;j!(\f 

istri:i:Qrt individual | dc:a 



ofadrr.in* 



of iniCKdfd 
usr 



?ninimcl I Both 



V/R 



• V • viltdtt^ data <v»ii«blc 

No trttty m«M(H ih»l ftp cbta »<fr We at iht umt ihn chin pftr«mj 



ma.Tpo^fc'Cr pre-' :5c—: v. . ; ':or^' 
crj-n t s a * d i ? h {>: ? - - 

' ; Twer.iy jjcms 
: rciating job 
! conditions or 
[ oppqrtunitirs 
; Subject r?jc5 
o Che nan tm- 
pC run cc J Ic, 

fclaiinp, 50 job 

Subject fa !C'» 
c^ch i^cm on 

I Hjjhi p:ife 4:^cv 
; tmnn^trecof:- 
; c-crntng per- 
ceived v* or k 

j One prifr form 
I for *jx 
! ijbcondiuoni 

r-^ clve nerrn 

} subject ts asked 
I lo select the 
I four mo^.t^?m. 

porunt job 
i condttton.^ for 

' •''iccn hjRh'iv- 
'Jrd ve!f. 
• cb^JOn 
:an m true- 

fotm 

Eighty iiem«' 
^bo'jibchav. 
lors'that the 
5ubjccl IS asked 
i to rate 
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Job HoW 
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C. Summary of Assessment Tools for the DiSAD\fM^TAGED— Continued 



tool 


1 ' ■ 

Furpose 
for which 

it was 
canstrucied 


planned 
purposes 


Tin\e 
needed (o 
administer 


Required 

skifUevel 
of tester 


Expense 
of admin- 
istration 


Group or 
or 

individual 


Validiiy. 
reliability^ 
normative 

data 
available ' 


Population 
of intended 
use 


Forma! 


}. Motivation 
for Voca- 
tional 
Achieve- 
ment 


Counseling and 
personal 
development 


Program cvalu- 


Vh hrs 


Medium 


Minimal 


Group 
(4-15) 


V/R/N 


Disadvantaged 
youth 16-21 


Seventeen items 
ill Likert-stylc 
format. 


k. Praciical 
Reasoning- 
Map Read- 
ing 


















Ten four-choice 
multiple 
response items. 


I. Praciicai 
Reasoning- 
Zip Coding 






• 












Ten items; mul- 
tiple-choice 
formal. 


m. Praciical 
Reasoning- 
File Card 
Sorting 

Educational 
Testing Scrv. 
ice NYC En. 
rollec and 
Former Ques- 
tionnaires 


Program evalu- 
ation short and 
long run effects 






- 


• 


Individual 


- 

V/R 




Ten multiple 
choice items: 
file cards are 
attached to 
test booklet. 

/ Interview for- 
mat; short 
answer sen- 
tence comple- 
tion and mul- 
tiple choice 
items. 


Goodvvin Work 
Orieniation 
Ouestionnaifc 


Research 


Counselor 
training 




Medium 


Minima! 


2'nh seir- 
adminiv 
lering 
and home 
interview 


V/R/N 


WIN trainees 


Eight-page 

questionnaire 
'with Likert- 

type items 

f 'agrcc-dis- 

agrec"). 


Indik Work 
Motivation 
Scales (motive 
to work, mo- 




Asjvignmcn! to 
training 


15 min. 


- 


Medium 


Individual 


V/R 


MDTA 
trainees 


Orally adminis- 
tered inter- 
vicw-iypc ques- 
tionnaire with 


tive to avoid 
work, expec- 
tancy to work. 
cxpcctafHjyjo 
avoid wcrk,Un- 
ccftUve ?o 
work) 


















Likert and 
multiple 
ciioicc comple- 
tion items. 


Jewish Employ- 
. mtni and Vo- 
caiiojial Scrv- 
jctrs Work 
Sample Sys- 
tem 

i 
f 

f 


Counseling and 
pcf jonal 
dcvcJopment 


Assignment to 
trnintnt?' inh 
placement 


1-2 weeks 


High 


High 


Both 


V/N 


Disadvantaged 


Twenty-eight 
work samples 
representing 
job activities in 
ten occupa- 
tional areas. 




i 

1 

















V • »«t>d«iyd»t»«»4ibbic - ' 

R'* rtU«bili»y diUat*iUMc - - . 

No entry me«tttth«i flod(t» wife ««»i(Abk 4t I Ke time I chart ^eturrd 
S'>t'«C# i3M4ct. Thv»m»i } . A/H^tsSt of AUftsif^it t^f OitQd*TxnitJtf\i rn Ma'if»^**rr Prifffctns A Fr*trw anj Anahiis. {tot Anftcics Hum*n !n(tfacir»tn Research IntJiJule. 197.^) 
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C. Summary of Assessment Tools for the DiSADVANTAGED~CD/jf/>2u^J 



Assessment 
iool 



JorgvTison, ct al 
Social Vocabu- 
lary Index 



Jorgcnr>on, ct al 
Revised Inter- 
action Scale 

Mandell. et al 
NYC En- 
rollee Inter- 
view Forms I 
and II 



NATB 



Psychological 
Corporation 
Multimedia 
Orientation 



Sdf-Conccpt 
Profiling 
Technique 
(O'Mahoney) 

Self- Interview 
Checklist 



Purpose 
for which 

it was 
constructed 



Test develop- 
ment and 
research 



Evaluation 9"^ 
program 
development 



Counseling and 
job placement 

Pre- testing 
orientation 



Counseling and 
personal 
development 



Job placement 



Other 
planned 
purposes 



Assignment to 
training 



Time 
needed to 
administer 



3^4 hrs. 



30 min. 



Required 
skilllevel 
of tester 



Medium 



Minimal 



Medium 



Minimal 



High 



Minimal 



Expense 
ofaamin- 
istraiion 



Minimal 



Medium 



Minimal 



Medium 



Minima! 



Group or 
or 

individual 



Both 



Individual 



Group 



Individual 



Validity, 
reliability, 
normative 

data 
available ' 



V/R 



V/R/N 



V/R 



V/R/N 



Population 
of intended 
use 



Rural rehabili- 
tation clients 



NYC enroUces 



Disadvantaged 



Disadvantaged 
clients with 
low test-taking 
skills 



Format 



Paper-and-pen« 
cil test, self-ad- 
ministering, 20 
items each on 
six scales: ^If- 
concept, seJf- 
acceptance! 
ideal-self, con- 
cept of others, 
vocabulary, ' 
and social 
desirability. 

Two-part paper- 
'and pencil 
questionnaire. 

Form I: 20 item 
multiple-choice 
or fill-in inter- 
view format. 
Form II: 58 
items giving 
job qualifica- 
tions or expec- 
tations, inter- 
view form; sub- 
ject rates items 
for degree of 
necessity or 
importance. 

Fourteen sub- 
tests, mostly 
nonverbal. 

Tape recording 
guides clients 
through a 
booklet of ex- 
ercises with 
test-like items. 
Clientsare 
given another 
similar booklet 
to take home. 

Projective tech- 
nique using 
pictures of peo- 
ple in work 
situations. 

^Job preference 
and experiepce 
checklist used 
aspartofClcff 
job/man 
matching. 



' V • validity dau kvkiUble. 
R • rciiabilily data avitlabte. 
N • normative data avaiUbl«, 

No entry meant that no data were available at the time this chart was prepared. 
SOLRCE Backer. Thontai E.. Aietkod^ of Asseuins ikt Disadvantaged in Manpowrr f^trwm: A Rrvie*^ and Analysis. {Loi\T\i^ci: Human Intcfiction Research Inftitute. 'l973> 
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C. Summary of Assessment Tools for the Disadvantaged— Con/mwec^ 



Assessment 
tool 



Singcr/Grailcx 
Vocational 
Evaiuation 
System 



Tolerance for 
Bureaucratic 
Structure 
Scale 

TOWER 
Evaluation 
System 

Tseng Rating 
Scales 

USES Pretest- 
ing Orienta- 
tion Exercises 



Vocational 
Exploration 
Groups 



Waithcr Work- 
Relevant 
Altitudes 
Inventory 



Wolf, ct al 
Attraction lo 
Work ScaJc. 
. Barrier to 
Work Scale. 
Loss Scale 



Purpose 
for which 

it was 
constructed 



Other 

planned 
purposes 



Counseling and 
personal 
development 



Job rlacerp ,u 



Counseling and 
personal 
development 

Research 



Pretesting 
orientation 



Counseling and 
personal 
dcvclopmcni 



Program evalu- 
ation and 
planning 



Job placement 



Work Behavior Assignment to 
Samples | (raining 



Assignment to 
training 



Time 
needed to 
administer 



Required 
skill level 
of tester 



Counseling and 
personal 
development 



3 weeks High 



High 



Expense 
of admin- 
istration 



High 



Minimal 



I hr. 



3-5 hrs. 



10-15 min 



Minimal 



Medium 



Minimal 



Minima! 



High 



Minimal 



Medium 



Minimal Both 



Group or 
or 

individual 



Group 



Validity 
reliability, 
normative 

data 
available 



N 



Both 



Group 



High 



Group 



Medium Individual 



R/N 



R/V/N 



V/R 



Population 
of intended 
use 



Vocational 
trainees, re- 
habilitation 
clients, disad- 
vantaged 



Manpower 
cnrollces 



Handicapped 



Trainees in vo- 
cational reha- 
bilitation 

Disadvantaged 



Manpower en- 
rollees 



NYC and New 
Careers 
cnrollees 



WIN trainees 



Manpower en- 
rollccs 



Format 



Teaching ma- 
chine, sound 
tape and film 
strip present 
prorrammcd 
insiraction in 
ten occupa- 
tional areas. 

Forty-th rcc 
items in four- 
point Likert 
scale format. 

One hundred ten 
work samples 

Short rating 
scales 

Short test book- 
let resembling 
GATBin 
format. 

Group process 
for interaction 
and personal- 
ization on 
topics of jobs. 

Twenty- six item 
inventory 
measuring fac- 
tors related to 
work adjust' . 
ment and 
satisfaction. 

Short paper- 
and-p>encil 
questionnaires. 



Under develop- 
ment; involves 
rating behavior 
of evaluees in 
real interper- 
sonal situa- 
tions. 



ilr U3.GOVEJINMEKT PRINTING OfTICE : 197fl 0~2«»-747 



V • validit) data availtble 
R • reliabthiy data available 
N . normativedtu availabk: 
Noentrymotntthalnodaia were available et t>£ nme thischart wasprepared. 

Sot.ct Backer. Thom<»E . Meihodiof Atteuing tht Dno^vontcgedin Monpo^rr Frogray^i A Heviewond AnatvsisALo^Angtln: Human Interaction Re«earch Institute. 1973) 



40 




43 



WHKRK rO CFT MORK INFORMATION 

I 

I'or more inrorniaiion, contact ihc E PH^loynicni and Training Adniinisiraiion. U.S. Dcparinicni' 
o\ Labor. Washington, D.C. 20213. or any of the Regional Adininisirafors for Lniploynicnt ancl 
Training whose addresses are lisied bclov\ . 



Location 

John I- . Kennedy Hldi; 
Bosion, Mass. 02:03 



1515 Bmaduiu 

Nev\ York, N.V. 1(H>a6 



f>.(). Box 8796 



1371 P ea e h i rce S i rec t . N ? 
Atlanta. Cia. 30309 



■ 230 South Dearborn Street 
C hieauo. Ill, 60604 



91 ! Walnut Street 
Kansas C ity. S\o. 64106 

555 Cirilfin Square Bldg. 
Dallas. Te\. 75202 



1961 St GUI Street 
Denver. Colo. so:*)4 



450 Goiden Gate Avenue 
San Kraneisco. Calif. 94102 



909 First Avenue 
Seattle, Wash." 98 174 



Served 
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Kansas 


Nebraska 
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(Oklahoma 
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Texas 


Nesv Me,\ieo 




Colorado . 


South Dakota 


Montana 


Utah ^ 


North Dakota 


Wyoming 


Arizona 


American Samoa 


Calitornia 


Guam 


Hawaii 


Trust Territory- 


Nevada 




Alaska 


Oregon 


Idaho 


Washington 
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ERIC 



